-- Logs begin at Thu 2022-05-05 14:33:12 UTC, end at Thu 2022-05-05 15:53:59 UTC. -- May 05 15:08:41.605893 dv-cinder-835881-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 05 15:08:41.616919 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 5 15:08:41 2022] *** May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: nodename: dv-cinder-835881-6-iscsi May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: machine: x86_64 May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: clock source: unix May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: pcre jit disabled May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: detected number of CPU cores: 4 May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: current working directory: / May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: detected binary path: /usr/bin/uwsgi-core May 05 15:08:41.618882 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: your processes number limit is 47680 May 05 15:08:41.619493 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: your memory page size is 4096 bytes May 05 15:08:41.619493 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: detected max file descriptor number: 2048 May 05 15:08:41.619493 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: lock engine: pthread robust mutexes May 05 15:08:41.619493 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: thunder lock: enabled May 05 15:08:41.619493 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 05 15:08:41.619493 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 05 15:08:41.664395 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: Python main interpreter initialized at 0x555941e099c0 May 05 15:08:41.664395 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: python threads support enabled May 05 15:08:41.664395 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: your server socket listen backlog is limited to 100 connections May 05 15:08:41.664395 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: your mercy for graceful operations on workers is 90 seconds May 05 15:08:41.664775 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: mapped 403077 bytes (393 KB) for 2 cores May 05 15:08:41.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: *** Operational MODE: preforking *** May 05 15:08:41.665070 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: *** uWSGI is running in multiple interpreter mode *** May 05 15:08:41.665070 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: spawned uWSGI master process (pid: 80072) May 05 15:08:41.665271 dv-cinder-835881-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 05 15:08:41.666810 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: spawned uWSGI worker 1 (pid: 80084, cores: 1) May 05 15:08:41.666810 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: spawned uWSGI worker 2 (pid: 80085, cores: 1) May 05 15:08:41.666810 dv-cinder-835881-6-iscsi devstack@keystone.service[80072]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 05 15:08:47.513433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:08:47.513433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: from cryptography.utils import int_from_bytes May 05 15:08:47.514249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:08:47.514249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: from cryptography.utils import int_from_bytes May 05 15:08:47.514658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:08:47.514658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: from cryptography.utils import int_from_bytes May 05 15:08:47.514763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:08:47.514763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: from cryptography.utils import int_from_bytes May 05 15:08:47.564469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 15:08:47.564647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 15:08:47.564741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 15:08:47.564832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] command line args: [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 15:08:47.564993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 15:08:47.565106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 15:08:47.565216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] command line args: [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 15:08:47.565306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ================================================================================ {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 15:08:47.565492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 15:08:47.565569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] admin_token = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.565672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ================================================================================ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 15:08:47.565757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] config_dir = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.565931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] admin_token = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.566012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.566117 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] config_source = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.566295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] config_dir = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.566904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] debug = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] config_source = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] debug = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.567979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] list_limit = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] log_config_append = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] log_dir = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] log_config_append = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.568981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] log_file = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] log_dir = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] log_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.569939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.570985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.571165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.571292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.571400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.571557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.571667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.571819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.571924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.572047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.572125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.572295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.572389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.572573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.572665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.572857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] publish_errors = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] publish_errors = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.573964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] standard_threads = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.574918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] standard_threads = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] use_journal = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] use_json = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] use_journal = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] use_stderr = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] use_json = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.575951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] use_syslog = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.576021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] use_stderr = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.576132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] use_syslog = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.576215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.576364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:08:47.576447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.576621 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.576699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.576860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.576944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.577981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.578972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579630 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579868 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.579945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.580933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.581107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.581182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.581347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.581425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.581581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.581663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.581833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.582011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.582700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.582791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.582964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.583941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.584898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.585933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.586907 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.587947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.588978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.589917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590540 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.590880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.591968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.592107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.592237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.592439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.592599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.592721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.592858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.592996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.593122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.593252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.593374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.593501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.593626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.593757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.593884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.594936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.595948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.596936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597117 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.597968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.598930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.599875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.600977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.601053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.601214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.601349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.601578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.601656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.601842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.601919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] auth.external = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.external = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.602917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] auth.password = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] auth.token = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.password = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.token = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.603885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.604990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] credential.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.605953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.606989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.607171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.607258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.607411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.607563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.607676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.607755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.607931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.608949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.609993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.610937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.611951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.612923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.613890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.614855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.615832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.616839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.617003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.617086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.617274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.617435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.617614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.617740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.617879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.618905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.619950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.620975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.621111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.621245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.621371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.621496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.621620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.621756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.621881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.622893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.623934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.624948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.625956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.626982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.627136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.627222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.627390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.627489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.627666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.627746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.627915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.636996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.637949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.638942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639664 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] role.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.639892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] role.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.640947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] role.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] role.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.641940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.642958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.643986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.644056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.644139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.644212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.644282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.644489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.645925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.646922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647160 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.647953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.648920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.649880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650562 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.650891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.651960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.652938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.653965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.connection = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.654992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.655118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 15:08:47.655244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.655244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.655514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.655636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.655862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.656113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.656354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.656603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.656848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.657105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.657342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.657749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.657993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.658242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.658484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:08:47.658658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 15:08:47.686155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.686388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.686617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.688822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.689063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.689293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.697324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.698683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.725747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.725979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.733184 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.733419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.780921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.781054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.832930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.833172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.833600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.835417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.901938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.902036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.902155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.902250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.902374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.925473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.925607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.926243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.926350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.926445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.926527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.926674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.926784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.926883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.927010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.927109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.927240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.927342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.927533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.938554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.938835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.953717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.953944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.954897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.955031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.955133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.955305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:08:47.972321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.972465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.972598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:08:47.972726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:08:47.972887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.973034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.973118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:08:47.973239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:08:47.973353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.973511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.973602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.973777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.973857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.974036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.974116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.974292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.985174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.985344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.985453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.985628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.985709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.985901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.985984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.986185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.994643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:47.994976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:47.997940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:47.998223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.998307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:47.998551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.998631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.998888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.998978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.999174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.999255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.999435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.999533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.999741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:47.999826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.000908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.001098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.028164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.028268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.029775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.029862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.030062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.030167 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.035890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.036005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.036123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.036237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.036403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.036524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.043682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.043787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.043968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.044098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.048566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.048753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.048839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.049997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.050178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.050260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.050447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.050563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.050756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.069601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.069877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.069986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.070269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.074392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.074768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.077996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.078292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.078379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.078662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.083289 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.083667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.086860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.087219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.090680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.090959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.091076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.091255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.091338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.091567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.091654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.091846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.091992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.092114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.092206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.092447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.111443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.111842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.112112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.112194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.112378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.112524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.112799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.113068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.120885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.122603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.122879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.123047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.125996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.126472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.126939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.127226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.127538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.127832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.128111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.129729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.130013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.130303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.130587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.130871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.145269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.145550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.145834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.146119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.146426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.146685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.146975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.147265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.147708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.148100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.148496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.148979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.149367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.149801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.165652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.168942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.172449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.174067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.174437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.175783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.176534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.176908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.178836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.182281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.183953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.184288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.185581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.185874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.186003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.186161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.189122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.189411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.189713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.189993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.193611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.195215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.198489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.198784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.199079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.199205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.199357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.199512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.199781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.207684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.207965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.208249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.208544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.208670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.208807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.208933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.209081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.209210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.209377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.209635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.209909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.210180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.210461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.210733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.211001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.211283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.217386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:08:48.217680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.217966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.218262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.218543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.218821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.219099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.219385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.219682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.219956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.220248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.220515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.220788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.221069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:08:48.250983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555941e099c0 pid: 80084 (default app) May 05 15:08:48.254442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1c06-c374-4b23-9a65-a73f67198ba6 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:48.254740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1c06-c374-4b23-9a65-a73f67198ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:48.255026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1c06-c374-4b23-9a65-a73f67198ba6 None None] PATH_INFO: `/v3` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:48.259255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Thu May 5 15:08:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:08:48.260998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555941e099c0 pid: 80085 (default app) May 05 15:08:57.117673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c7a9-8595-400b-9b32-41dd38243bb7 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:57.118201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c7a9-8595-400b-9b32-41dd38243bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:57.118285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c7a9-8595-400b-9b32-41dd38243bb7 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:57.119607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:08:57.127171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:57.127610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:57.127785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:57.157918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG oslo_db.sqlalchemy.engines [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 15:08:57.340650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG passlib.handlers.bcrypt [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80085) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 15:08:57.341072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG passlib.handlers.bcrypt [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80085) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 15:08:57.397192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:08:57.398725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:08:57.521842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1/3] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:08:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 05 15:08:57.663372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c7a9-8595-400b-9b32-41dd38243bb7 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:57.696417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG oslo_db.sqlalchemy.engines [None req-73b3c7a9-8595-400b-9b32-41dd38243bb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 15:08:57.822946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c7a9-8595-400b-9b32-41dd38243bb7 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:57.827164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bc922-7606-403f-8d95-4c7e48ac53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:57.827853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bc922-7606-403f-8d95-4c7e48ac53d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:57.828144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bc922-7606-403f-8d95-4c7e48ac53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:57.828427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bc922-7606-403f-8d95-4c7e48ac53d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:57.837244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bc922-7606-403f-8d95-4c7e48ac53d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:57.887959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING keystone.common.rbac_enforcer.enforcer [None req-012bc922-7606-403f-8d95-4c7e48ac53d5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 15:08:57.888313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bc922-7606-403f-8d95-4c7e48ac53d5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:57.898917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1324 bytes} [Thu May 5 15:08:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:08:57.904833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:08:57.918923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62592c78-d715-473b-a3b2-58c5c2c274bf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:08:57.923230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce81612-1395-4f50-b414-2866153f925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:08:57.924448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce81612-1395-4f50-b414-2866153f925c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:08:57.924740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce81612-1395-4f50-b414-2866153f925c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:08:57.925020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce81612-1395-4f50-b414-2866153f925c admin admin] PATH_INFO: `/v3/projects/a3a7cd6436bd466e8794acccf97ede79` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:08:57.926549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce81612-1395-4f50-b414-2866153f925c admin admin] RBAC: Authorizing `identity:get_project(project_id=a3a7cd6436bd466e8794acccf97ede79)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:08:57.980880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ce81612-1395-4f50-b414-2866153f925c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 15:08:57.981234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce81612-1395-4f50-b414-2866153f925c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:08:57.985964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 2/5] 10.222.0.55 () {56 vars in 1207 bytes} [Thu May 5 15:08:57 2022] GET /identity/v3/projects/a3a7cd6436bd466e8794acccf97ede79 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:00.255675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c89d9-149e-4c3b-ae3d-96911a47da91 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:00.256197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c89d9-149e-4c3b-ae3d-96911a47da91 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:00.256346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c89d9-149e-4c3b-ae3d-96911a47da91 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:00.260446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 4/6] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:00.265900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af213-5b5b-405e-940a-5f43785dd8ef None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:00.266308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af213-5b5b-405e-940a-5f43785dd8ef None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:00.266456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af213-5b5b-405e-940a-5f43785dd8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:00.287270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a00af213-5b5b-405e-940a-5f43785dd8ef None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:00.288784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a00af213-5b5b-405e-940a-5f43785dd8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:00.296709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 3/7] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 05 15:09:00.319279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c89d9-149e-4c3b-ae3d-96911a47da91 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:00.331031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c89d9-149e-4c3b-ae3d-96911a47da91 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:00.335820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7e14e-7548-4375-a566-f1e2b29b9dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:00.336460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7e14e-7548-4375-a566-f1e2b29b9dba admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:00.336750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7e14e-7548-4375-a566-f1e2b29b9dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:00.337033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7e14e-7548-4375-a566-f1e2b29b9dba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:00.344739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7e14e-7548-4375-a566-f1e2b29b9dba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:00.346507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7e14e-7548-4375-a566-f1e2b29b9dba admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:00.355180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 5/8] 10.222.0.55 () {58 vars in 1324 bytes} [Thu May 5 15:09:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:09:00.361252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00af213-5b5b-405e-940a-5f43785dd8ef None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:00.370424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00af213-5b5b-405e-940a-5f43785dd8ef None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:00.374868 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84351c0-1383-4662-bb79-3de0b6e2acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:00.375763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84351c0-1383-4662-bb79-3de0b6e2acdd admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:00.376053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84351c0-1383-4662-bb79-3de0b6e2acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:00.376388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84351c0-1383-4662-bb79-3de0b6e2acdd admin admin] PATH_INFO: `/v3/users/f207ee062b9d45669b77905195363950` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:00.377912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84351c0-1383-4662-bb79-3de0b6e2acdd admin admin] RBAC: Authorizing `identity:get_user(user_id=f207ee062b9d45669b77905195363950)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:00.380288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84351c0-1383-4662-bb79-3de0b6e2acdd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:00.381887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 4/9] 10.222.0.55 () {56 vars in 1198 bytes} [Thu May 5 15:09:00 2022] GET /identity/v3/users/f207ee062b9d45669b77905195363950 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:02.770866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48bf3f-ffef-4c9a-b4e4-e604336e3b80 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:02.771327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48bf3f-ffef-4c9a-b4e4-e604336e3b80 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:02.771436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48bf3f-ffef-4c9a-b4e4-e604336e3b80 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:02.772852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:02.777875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6739-4c4d-4034-93c1-a8e3b0604226 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:02.778263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6739-4c4d-4034-93c1-a8e3b0604226 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:02.778435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6739-4c4d-4034-93c1-a8e3b0604226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:02.793095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9439c-f311-4f6f-b4b0-0c9193a6ffc7 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:02.793391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9439c-f311-4f6f-b4b0-0c9193a6ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:02.793673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9439c-f311-4f6f-b4b0-0c9193a6ffc7 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:02.795089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 7/11] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:02.801773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:02.802073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:02.802357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:02.844151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG passlib.handlers.bcrypt [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80084) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 15:09:02.844590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG passlib.handlers.bcrypt [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80084) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 15:09:02.892214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:02.894649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:02.905410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ad0d6739-4c4d-4034-93c1-a8e3b0604226 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:02.906592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ad0d6739-4c4d-4034-93c1-a8e3b0604226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:02.985134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 5/12] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:02.992899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 8/13] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:03.007980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d6739-4c4d-4034-93c1-a8e3b0604226 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.014560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.111380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f33241-f644-4e03-a894-b45032aa366d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.123349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d6739-4c4d-4034-93c1-a8e3b0604226 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.145117 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.146025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.146315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.146596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.156602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.157398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.157680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.157961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.168867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:03.179873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:03.180756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:03.181608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 6/14] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:03.186868 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.212207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:03.213737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:03.283798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04c78-9949-494e-8dab-7c4df93b72c4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.309159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 9/15] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:09:03.314938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.319339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.320127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.320419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.320706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.321475 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:03.321788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:03.323221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:03.337170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 7/16] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:03.343054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.446270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c265057-0f8a-41f5-b1c8-261603060999 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.479962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.480854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.481150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.481524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] PATH_INFO: `/v3/users/f207ee062b9d45669b77905195363950` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.491640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] RBAC: Authorizing `identity:get_user(user_id=f207ee062b9d45669b77905195363950)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:03.493146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:03.494826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 8/17] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/users/f207ee062b9d45669b77905195363950 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:03.500185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.522917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b717-35cf-4938-9b78-1e26851f2c64 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.560473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.561193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.561477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.561755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.580969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:03.582465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:09:03.602725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:03.603633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:03.604448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:09:03.604448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:09:03.604448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:09:03.604448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:03.604648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535128-39a6-4f85-a231-13812818aa51 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.604723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:03.609813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.639978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.640774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.641116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.641400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.642593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:03.644403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:03.650821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:03.651772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:03.711016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd8d06-d180-4e6c-9a17-d5e011adec2b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.746389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd074c-4d1a-41f4-8938-430c5b45cab9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:03.746579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70fd4-dae5-4bb8-af09-5681f27b1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.747172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70fd4-dae5-4bb8-af09-5681f27b1f0a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.747456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70fd4-dae5-4bb8-af09-5681f27b1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.747763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70fd4-dae5-4bb8-af09-5681f27b1f0a None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.748494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70fd4-dae5-4bb8-af09-5681f27b1f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:03.748803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70fd4-dae5-4bb8-af09-5681f27b1f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:03.751769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70fd4-dae5-4bb8-af09-5681f27b1f0a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:03.768832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:03.780439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d692fd-b5ee-459b-bc9f-1621b3f20ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:03.781116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d692fd-b5ee-459b-bc9f-1621b3f20ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:03.781400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d692fd-b5ee-459b-bc9f-1621b3f20ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:03.781675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d692fd-b5ee-459b-bc9f-1621b3f20ac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:03.782531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d692fd-b5ee-459b-bc9f-1621b3f20ac7 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.domain.id=default, user.id=f207ee062b9d45669b77905195363950) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:03.782843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d692fd-b5ee-459b-bc9f-1621b3f20ac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:03.784917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d692fd-b5ee-459b-bc9f-1621b3f20ac7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:03.792971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1322 bytes} [Thu May 5 15:09:03 2022] GET /identity/v3/role_assignments?user.id=f207ee062b9d45669b77905195363950&scope.domain.id=default&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:06.447514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ddeb-64d2-40be-ae97-f17d7956cd2b None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:06.448574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ddeb-64d2-40be-ae97-f17d7956cd2b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:06.449082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ddeb-64d2-40be-ae97-f17d7956cd2b None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:06.451133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:06.456689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43551d-635a-438e-996c-0cf82a81b562 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:06.457667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43551d-635a-438e-996c-0cf82a81b562 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:06.458178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43551d-635a-438e-996c-0cf82a81b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:06.480148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7e43551d-635a-438e-996c-0cf82a81b562 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:06.481695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7e43551d-635a-438e-996c-0cf82a81b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:06.576803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:06.611128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045ddeb-64d2-40be-ae97-f17d7956cd2b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:06.653918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be06c-27ab-40cb-821c-85c3a94c349e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:06.654549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be06c-27ab-40cb-821c-85c3a94c349e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:06.655033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be06c-27ab-40cb-821c-85c3a94c349e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:06.656658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:06.662738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a720-b2db-4b8e-a438-400b02e160e3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:06.663314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a720-b2db-4b8e-a438-400b02e160e3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:06.663822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a720-b2db-4b8e-a438-400b02e160e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:06.695966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f6d0a720-b2db-4b8e-a438-400b02e160e3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:06.697592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f6d0a720-b2db-4b8e-a438-400b02e160e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:06.814702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045ddeb-64d2-40be-ae97-f17d7956cd2b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:06.858565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:06.886879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f5dcb-39e2-4baa-bfea-d63e2655e256 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:06.887324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce71ce-7bc5-4b27-bbe3-d0d7304df1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:06.887867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f5dcb-39e2-4baa-bfea-d63e2655e256 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:06.888174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce71ce-7bc5-4b27-bbe3-d0d7304df1fd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:06.888469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce71ce-7bc5-4b27-bbe3-d0d7304df1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:06.888740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f5dcb-39e2-4baa-bfea-d63e2655e256 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:06.888837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce71ce-7bc5-4b27-bbe3-d0d7304df1fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:06.890887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 14/26] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:06.900771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f5dcb-39e2-4baa-bfea-d63e2655e256 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:06.920038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce71ce-7bc5-4b27-bbe3-d0d7304df1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-18ce71ce-7bc5-4b27-bbe3-d0d7304df1fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:06.930963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:06.931919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:06.932673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:06.943645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 13/27] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:06.945354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc25d-eb4a-4bfd-b60d-6382b7fb1eb2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:06.945769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc25d-eb4a-4bfd-b60d-6382b7fb1eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:06.946166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc25d-eb4a-4bfd-b60d-6382b7fb1eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:06.979628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-014bc25d-eb4a-4bfd-b60d-6382b7fb1eb2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:06.980781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-014bc25d-eb4a-4bfd-b60d-6382b7fb1eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:07.076571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f5dcb-39e2-4baa-bfea-d63e2655e256 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:07.119615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 14/28] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:07.121045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc25d-eb4a-4bfd-b60d-6382b7fb1eb2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:07.127043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad2b26-6201-44a8-9475-dd49dfec43fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:07.128778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2b26-6201-44a8-9475-dd49dfec43fe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.129220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2b26-6201-44a8-9475-dd49dfec43fe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.129642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2b26-6201-44a8-9475-dd49dfec43fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.140655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad2b26-6201-44a8-9475-dd49dfec43fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:07.142430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad2b26-6201-44a8-9475-dd49dfec43fe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d9ad2b26-6201-44a8-9475-dd49dfec43fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:09:07.163177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:07.164251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:07.165283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:09:07.165283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:09:07.165283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:09:07.165283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:07.167215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 15/29] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:07.168832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8493a-bae1-47a8-b69e-b4c405c95afe None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.169269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8493a-bae1-47a8-b69e-b4c405c95afe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.169690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8493a-bae1-47a8-b69e-b4c405c95afe None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.171402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:07.172284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8493a-bae1-47a8-b69e-b4c405c95afe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:07.230476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc25d-eb4a-4bfd-b60d-6382b7fb1eb2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:07.266555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:07.267518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.268220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.269890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.270854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:07.271318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:07.272905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:07.281044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8493a-bae1-47a8-b69e-b4c405c95afe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:07.288064 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 15/31] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:07.289092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:07.318622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:07.319644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.320079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.320522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.321514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:07.323057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:07.395625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbe38d-9953-4883-9991-b325a030a3c8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:07.434499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f13726-5746-4b23-b8e9-2ce0d4591e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:07.435227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f13726-5746-4b23-b8e9-2ce0d4591e22 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.435586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f13726-5746-4b23-b8e9-2ce0d4591e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.435876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f13726-5746-4b23-b8e9-2ce0d4591e22 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.436632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f13726-5746-4b23-b8e9-2ce0d4591e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:07.436944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f13726-5746-4b23-b8e9-2ce0d4591e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:07.438389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f13726-5746-4b23-b8e9-2ce0d4591e22 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:07.453297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 16/32] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:07.454819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8b013-8762-4adf-a2d8-a9677e0d367d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.455123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8b013-8762-4adf-a2d8-a9677e0d367d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.455413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8b013-8762-4adf-a2d8-a9677e0d367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.474143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8fb8b013-8762-4adf-a2d8-a9677e0d367d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:07.475438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8fb8b013-8762-4adf-a2d8-a9677e0d367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:07.550108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 17/33] 10.222.0.55 () {60 vars in 1131 bytes} [Thu May 5 15:09:07 2022] POST /identity/v3/roles => generated 225 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:07.552040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:07.555584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 17/34] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:07.556901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8b013-8762-4adf-a2d8-a9677e0d367d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:07.693465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8b013-8762-4adf-a2d8-a9677e0d367d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:07.774843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe1cdf-06bb-404e-ab0a-f2909b0e4073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:07.775801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1cdf-06bb-404e-ab0a-f2909b0e4073 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.776228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1cdf-06bb-404e-ab0a-f2909b0e4073 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.776669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1cdf-06bb-404e-ab0a-f2909b0e4073 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.778402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe1cdf-06bb-404e-ab0a-f2909b0e4073 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:07.780324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe1cdf-06bb-404e-ab0a-f2909b0e4073 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:07.793603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22e8ab-b71c-4e6c-9963-5547d32d10e1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:07.832942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:07.833371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.833663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.836536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] PATH_INFO: `/v3/users/f207ee062b9d45669b77905195363950` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.836536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] RBAC: Authorizing `identity:get_user(user_id=f207ee062b9d45669b77905195363950)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:07.837049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:07.839703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 18/35] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:07 2022] GET /identity/v3/users/f207ee062b9d45669b77905195363950 => generated 247 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:07.839703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:07.945181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bbfb3-c4cd-40cf-a4ad-0a846692d985 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:07.980797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159afdf-515a-437b-8f79-3afe31a04c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:07.981491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159afdf-515a-437b-8f79-3afe31a04c9d None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.981783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159afdf-515a-437b-8f79-3afe31a04c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.982063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159afdf-515a-437b-8f79-3afe31a04c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:07.982816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159afdf-515a-437b-8f79-3afe31a04c9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:07.984235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159afdf-515a-437b-8f79-3afe31a04c9d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:07.994083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 18/36] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:09:07 2022] POST /identity/v3/projects => generated 301 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:07.995665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e6ddf-fe01-40f7-8783-6b54feb5ab7f None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:07.995969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e6ddf-fe01-40f7-8783-6b54feb5ab7f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:07.996320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e6ddf-fe01-40f7-8783-6b54feb5ab7f None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.002202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 19/37] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:08.002202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e6ddf-fe01-40f7-8783-6b54feb5ab7f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:08.042872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 19/38] 10.222.0.55 () {60 vars in 1131 bytes} [Thu May 5 15:09:07 2022] POST /identity/v3/roles => generated 219 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:08.046165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370aa1-384d-45c9-8bbc-fc1af48a9ccd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.046969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370aa1-384d-45c9-8bbc-fc1af48a9ccd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.047897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370aa1-384d-45c9-8bbc-fc1af48a9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.072742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3c370aa1-384d-45c9-8bbc-fc1af48a9ccd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:08.075151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3c370aa1-384d-45c9-8bbc-fc1af48a9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:08.169902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 20/39] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:08.214067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c370aa1-384d-45c9-8bbc-fc1af48a9ccd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:08.236292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e6ddf-fe01-40f7-8783-6b54feb5ab7f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:08.277554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:08.278332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.278668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.278952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.281150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:08.282621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:08.285527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 20/40] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:08.291264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:08.362240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c370aa1-384d-45c9-8bbc-fc1af48a9ccd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:08.406184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1e17a-3d47-4ff5-848b-ac648f0cc32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:08.407237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e17a-3d47-4ff5-848b-ac648f0cc32b None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.407237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e17a-3d47-4ff5-848b-ac648f0cc32b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.407602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e17a-3d47-4ff5-848b-ac648f0cc32b None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.408373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1e17a-3d47-4ff5-848b-ac648f0cc32b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:08.410284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1e17a-3d47-4ff5-848b-ac648f0cc32b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:08.413351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a4c8-93e7-4a0b-abe5-316abc23d55c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:08.446149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:08.446951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.447239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.447558 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] PATH_INFO: `/v3/domains/default/users/f207ee062b9d45669b77905195363950/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.449950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f207ee062b9d45669b77905195363950, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:08.451413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:08.475473 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1131 bytes} [Thu May 5 15:09:08 2022] POST /identity/v3/roles => generated 223 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:09:08.476992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce0ae-f1b1-4335-92d4-c97efee415ae None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.477278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce0ae-f1b1-4335-92d4-c97efee415ae None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.477563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce0ae-f1b1-4335-92d4-c97efee415ae None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.478825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 22/42] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:08.484575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c3a8-a9a0-4a51-9965-d48f7d82f420 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.484870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c3a8-a9a0-4a51-9965-d48f7d82f420 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.485155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c3a8-a9a0-4a51-9965-d48f7d82f420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.503792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1d65c3a8-a9a0-4a51-9965-d48f7d82f420 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:08.505031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1d65c3a8-a9a0-4a51-9965-d48f7d82f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:08.536102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 21/43] 10.222.0.55 () {58 vars in 1361 bytes} [Thu May 5 15:09:08 2022] PUT /identity/v3/domains/default/users/f207ee062b9d45669b77905195363950/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:08.598387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 23/44] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:08.622392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:08.739459 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e70e2b-fe08-417f-bcb5-c1a5a412f46d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:08.782716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23577e-a630-4782-98e5-2f0f34eaaccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:08.783553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23577e-a630-4782-98e5-2f0f34eaaccd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.783850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23577e-a630-4782-98e5-2f0f34eaaccd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.784685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23577e-a630-4782-98e5-2f0f34eaaccd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.785869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23577e-a630-4782-98e5-2f0f34eaaccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:08.787327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23577e-a630-4782-98e5-2f0f34eaaccd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:08.788975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 22/45] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:08.794723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c3a8-a9a0-4a51-9965-d48f7d82f420 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:08.889237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c3a8-a9a0-4a51-9965-d48f7d82f420 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:08.922802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4592-3b4a-45b1-8f6d-5797ad5ec89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:08.923491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4592-3b4a-45b1-8f6d-5797ad5ec89d None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:08.923791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4592-3b4a-45b1-8f6d-5797ad5ec89d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:08.924072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4592-3b4a-45b1-8f6d-5797ad5ec89d None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:08.924819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4592-3b4a-45b1-8f6d-5797ad5ec89d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:08.926290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4592-3b4a-45b1-8f6d-5797ad5ec89d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:09.001509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:09:08 2022] POST /identity/v3/projects => generated 312 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:09:10.771938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83a5e7-d68d-4496-a1fa-587a226e0b8f None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:10.772413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83a5e7-d68d-4496-a1fa-587a226e0b8f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:10.772521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83a5e7-d68d-4496-a1fa-587a226e0b8f None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:10.773882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 23/47] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:10.779114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeece2-9340-4cff-b55d-684f0e60eece None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:10.779531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeece2-9340-4cff-b55d-684f0e60eece None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:10.779749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeece2-9340-4cff-b55d-684f0e60eece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:10.796136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e8aeece2-9340-4cff-b55d-684f0e60eece None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:10.797327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e8aeece2-9340-4cff-b55d-684f0e60eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:10.861145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 25/48] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:10.884254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83a5e7-d68d-4496-a1fa-587a226e0b8f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:10.981528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83a5e7-d68d-4496-a1fa-587a226e0b8f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:11.014388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:11.015122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.015413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.015724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.025817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:11.033413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:11.034248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:11.035019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 24/49] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:11.040424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeece2-9340-4cff-b55d-684f0e60eece None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:11.141244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeece2-9340-4cff-b55d-684f0e60eece None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:11.174400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393ee72-0870-4175-a36c-84149d652f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:11.175102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ee72-0870-4175-a36c-84149d652f62 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.175393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ee72-0870-4175-a36c-84149d652f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.175706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ee72-0870-4175-a36c-84149d652f62 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.176468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393ee72-0870-4175-a36c-84149d652f62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:11.176786 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393ee72-0870-4175-a36c-84149d652f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:11.178182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393ee72-0870-4175-a36c-84149d652f62 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:11.186347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 26/50] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:11.191709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:11.246159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359417-b73e-4221-afa5-5b37eb93c60b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.246451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359417-b73e-4221-afa5-5b37eb93c60b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.246775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359417-b73e-4221-afa5-5b37eb93c60b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.248187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 27/51] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:11.252965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0b8e-6a66-443b-87bd-870cf33c8e96 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.253257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0b8e-6a66-443b-87bd-870cf33c8e96 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.253547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0b8e-6a66-443b-87bd-870cf33c8e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.270999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-987c0b8e-6a66-443b-87bd-870cf33c8e96 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:11.272156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-987c0b8e-6a66-443b-87bd-870cf33c8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:11.287676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37573f44-d632-4e76-9440-15daca9a8072 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:11.319829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:11.320710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.321000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.321282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] PATH_INFO: `/v3/users/f207ee062b9d45669b77905195363950` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.322508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=f207ee062b9d45669b77905195363950)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:11.324012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:11.325664 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 25/52] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:11 2022] GET /identity/v3/users/f207ee062b9d45669b77905195363950 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:11.331534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:11.336222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 28/53] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:11.358442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0b8e-6a66-443b-87bd-870cf33c8e96 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:11.424913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868af97-6633-4d89-9e89-1da6a045f8d9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:11.450176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0b8e-6a66-443b-87bd-870cf33c8e96 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:11.457827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:11.458617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.458898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.459174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.460411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:11.461857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:11.463460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 26/54] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:11.469139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:11.482436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:11.483237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.483554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.483833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.485012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:11.486458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:11.488264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 29/55] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:11.493829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:11.590595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295904cc-e911-400e-bc98-f37a7de77238 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:11.616355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae728f-4adb-490c-8d9d-69d0b5691674 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:11.623369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff31f1-6ca6-4897-a427-6f67aa99ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:11.624051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff31f1-6ca6-4897-a427-6f67aa99ac04 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.624338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff31f1-6ca6-4897-a427-6f67aa99ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.624618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff31f1-6ca6-4897-a427-6f67aa99ac04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.625449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff31f1-6ca6-4897-a427-6f67aa99ac04 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.domain.id=default, user.id=f207ee062b9d45669b77905195363950) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:11.625764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff31f1-6ca6-4897-a427-6f67aa99ac04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:11.627193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff31f1-6ca6-4897-a427-6f67aa99ac04 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:11.635642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 27/56] 10.222.0.55 () {56 vars in 1322 bytes} [Thu May 5 15:09:11 2022] GET /identity/v3/role_assignments?user.id=f207ee062b9d45669b77905195363950&scope.domain.id=default&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:11.650286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05d6eb-03aa-4bb9-bff6-2b64264692ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:11.651002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05d6eb-03aa-4bb9-bff6-2b64264692ca None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:11.651285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05d6eb-03aa-4bb9-bff6-2b64264692ca None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:11.651601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05d6eb-03aa-4bb9-bff6-2b64264692ca None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:11.652345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05d6eb-03aa-4bb9-bff6-2b64264692ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:11.653849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05d6eb-03aa-4bb9-bff6-2b64264692ca None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:11.847570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 30/57] 10.222.0.55 () {60 vars in 1140 bytes} [Thu May 5 15:09:11 2022] POST /identity/v3/projects => generated 298 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:09:14.109504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d01c-d9d9-4419-8498-ee3c678d270e None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:14.110019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d01c-d9d9-4419-8498-ee3c678d270e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:14.110106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d01c-d9d9-4419-8498-ee3c678d270e None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:14.111444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 28/58] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:14.116680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8f48-92c7-4e85-97fa-0d934cc53056 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:14.117088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8f48-92c7-4e85-97fa-0d934cc53056 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:14.117244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8f48-92c7-4e85-97fa-0d934cc53056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:14.133354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-499c8f48-92c7-4e85-97fa-0d934cc53056 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:14.134537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-499c8f48-92c7-4e85-97fa-0d934cc53056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:14.197219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 31/59] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:14.221329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83d01c-d9d9-4419-8498-ee3c678d270e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:14.319255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83d01c-d9d9-4419-8498-ee3c678d270e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:14.361079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4687a-0a64-491b-8677-a11d5f880e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:14.361793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4687a-0a64-491b-8677-a11d5f880e6c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:14.362111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4687a-0a64-491b-8677-a11d5f880e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:14.362398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4687a-0a64-491b-8677-a11d5f880e6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:14.363613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4687a-0a64-491b-8677-a11d5f880e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:14.365108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4687a-0a64-491b-8677-a11d5f880e6c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:14.366731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 29/60] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:14.372420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8f48-92c7-4e85-97fa-0d934cc53056 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:14.466378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8f48-92c7-4e85-97fa-0d934cc53056 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:14.499061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c339a9-2f85-4e51-a89d-31d335d8b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:14.499754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c339a9-2f85-4e51-a89d-31d335d8b680 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:14.500043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c339a9-2f85-4e51-a89d-31d335d8b680 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:14.500322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c339a9-2f85-4e51-a89d-31d335d8b680 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:14.501021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c339a9-2f85-4e51-a89d-31d335d8b680 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:14.502483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c339a9-2f85-4e51-a89d-31d335d8b680 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:14.611421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 32/61] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:09:14 2022] POST /identity/v3/users => generated 275 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:17.988400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833c4b-dae1-4936-84f3-11b6a7c52d47 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:17.989482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833c4b-dae1-4936-84f3-11b6a7c52d47 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:17.989984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833c4b-dae1-4936-84f3-11b6a7c52d47 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:17.991874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 30/62] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:17.996956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c843b7-eb58-446f-b551-6c7ac4d9b0d7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:17.997426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c843b7-eb58-446f-b551-6c7ac4d9b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:17.997507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c843b7-eb58-446f-b551-6c7ac4d9b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.020426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-12c843b7-eb58-446f-b551-6c7ac4d9b0d7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:18.021553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-12c843b7-eb58-446f-b551-6c7ac4d9b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:18.114594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 33/63] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:18.153973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9833c4b-dae1-4936-84f3-11b6a7c52d47 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:18.293580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9833c4b-dae1-4936-84f3-11b6a7c52d47 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:18.345432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94266d-a496-4ec4-b4e2-86b7c527351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:18.346836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94266d-a496-4ec4-b4e2-86b7c527351c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.347128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94266d-a496-4ec4-b4e2-86b7c527351c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.347413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94266d-a496-4ec4-b4e2-86b7c527351c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.365198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94266d-a496-4ec4-b4e2-86b7c527351c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-6d94266d-a496-4ec4-b4e2-86b7c527351c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:18.372673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:18.373616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:18.375304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 31/64] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:18.380190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c843b7-eb58-446f-b551-6c7ac4d9b0d7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:18.492907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619259-d9d9-42be-b8f5-0d20be3b8916 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.493275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619259-d9d9-42be-b8f5-0d20be3b8916 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.493442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c843b7-eb58-446f-b551-6c7ac4d9b0d7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:18.493611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619259-d9d9-42be-b8f5-0d20be3b8916 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.495082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 32/65] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:18.506294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a6b6-17c7-4c26-97be-e2e337a5509b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.506954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a6b6-17c7-4c26-97be-e2e337a5509b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.507447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a6b6-17c7-4c26-97be-e2e337a5509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.540805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c664a6b6-17c7-4c26-97be-e2e337a5509b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:18.542362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c664a6b6-17c7-4c26-97be-e2e337a5509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:18.545157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:18.545789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.546076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.546357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.547128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:18.547442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:18.550354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:18.559830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 34/66] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:18.566960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:18.675724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 33/67] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:18.677889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c72b-a541-4aa0-bbcd-fdaabf58bff4 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.678189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c72b-a541-4aa0-bbcd-fdaabf58bff4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.678475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c72b-a541-4aa0-bbcd-fdaabf58bff4 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.681540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 34/68] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:18.683554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e5710-5b11-4d95-bf2d-1d28c990a73c None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.683853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e5710-5b11-4d95-bf2d-1d28c990a73c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.684141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e5710-5b11-4d95-bf2d-1d28c990a73c None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.685698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 35/69] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:18.685821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e53f-eb39-4f80-856d-68451cbc6fe9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:18.686800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a770-f4c2-4eec-a888-f308db0aefab None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.687090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a770-f4c2-4eec-a888-f308db0aefab None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.687372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a770-f4c2-4eec-a888-f308db0aefab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.708746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f819a770-f4c2-4eec-a888-f308db0aefab None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:18.709959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f819a770-f4c2-4eec-a888-f308db0aefab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:18.722909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34e549-399a-471d-96a6-0110547678c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:18.723914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e549-399a-471d-96a6-0110547678c7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.724201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e549-399a-471d-96a6-0110547678c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.724479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e549-399a-471d-96a6-0110547678c7 None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.738450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34e549-399a-471d-96a6-0110547678c7 None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:18.739663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34e549-399a-471d-96a6-0110547678c7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:18.741398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 35/70] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:18 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:18.746045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5f11-8145-42f0-8307-7d6914d2b3c7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.746045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5f11-8145-42f0-8307-7d6914d2b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.746045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5f11-8145-42f0-8307-7d6914d2b3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.760997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-83fe5f11-8145-42f0-8307-7d6914d2b3c7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:18.762210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-83fe5f11-8145-42f0-8307-7d6914d2b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:18.781825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 36/71] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:18.783170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a770-f4c2-4eec-a888-f308db0aefab None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:18.828310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 36/72] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:18.829803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016daba-09fd-4c00-8a6f-130bc250d072 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.830103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016daba-09fd-4c00-8a6f-130bc250d072 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.831279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016daba-09fd-4c00-8a6f-130bc250d072 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.832808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 37/73] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:18.833447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016daba-09fd-4c00-8a6f-130bc250d072 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:18.890810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a770-f4c2-4eec-a888-f308db0aefab None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:18.925082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:18.925885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.926168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.926445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:18.937011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:18.937227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016daba-09fd-4c00-8a6f-130bc250d072 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:18.945286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:18.946192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:18.946980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:18.951265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 37/74] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:18.952040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:18.972149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:18.972813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:18.973111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:18.973398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.037661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.039162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.046918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb533c-0074-4ef0-a8e3-ef6e9acd3293 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.079368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816020b4-ab2b-4368-b121-988910efb671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.080139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816020b4-ab2b-4368-b121-988910efb671 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.080483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816020b4-ab2b-4368-b121-988910efb671 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.081272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816020b4-ab2b-4368-b121-988910efb671 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.091176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816020b4-ab2b-4368-b121-988910efb671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-816020b4-ab2b-4368-b121-988910efb671 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:19.099228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:19.100306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:19.101250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:19.104835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735b270-db75-464f-b819-e3633239e98a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.105129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735b270-db75-464f-b819-e3633239e98a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.105411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735b270-db75-464f-b819-e3633239e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.121581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7735b270-db75-464f-b819-e3633239e98a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:19.122791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7735b270-db75-464f-b819-e3633239e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:19.142046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 38/76] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:19.142046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.187390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 39/77] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:19.188294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735b270-db75-464f-b819-e3633239e98a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.233549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3910e-5158-4bfe-b265-b5d7767126fe None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.266184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.266983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.267263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.267827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.269064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.270537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.272211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 39/78] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:19.273007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.285413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735b270-db75-464f-b819-e3633239e98a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.318882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.319589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.319888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.320168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.320933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:19.321248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.322651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.330796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 40/79] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:19.331569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.367853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0c06f-19e2-4fb0-a146-33f28a1a7257 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.400765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.401438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.401724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.402001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.402754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:19.403057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.404460 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.412322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 40/80] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:19.413127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.436209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c01e0-814d-49ac-86c0-8da089f1bd2a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.468683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.469551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.469840 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.470125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.471357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.472854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.474562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 41/81] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:19.479829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.508723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4975d-1949-4c02-bfa4-7d6bb5847517 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.541147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.541945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.542289 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.542571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.553386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:19.561040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:19.562034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:19.562925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 41/82] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:19.568304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.573501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3ed39-86da-4416-9819-8493b22fdfe4 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.606847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.607444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.607766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.608051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.608772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.610242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.665054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e2bde-9055-4d84-b45c-3aab8b46786a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.691410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 42/83] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:09:19 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:19.692334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.698469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.699861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.700342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.700843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] PATH_INFO: `/v3/users/f207ee062b9d45669b77905195363950` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.702547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] RBAC: Authorizing `identity:get_user(user_id=f207ee062b9d45669b77905195363950)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.704363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.706399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 42/84] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/users/f207ee062b9d45669b77905195363950 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:19.707166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.806069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa31ac8-da4f-49ce-958f-ccc0403d1149 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.822666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb922b2-81fb-4513-9257-d93a3f8165be None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.843422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.844398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.844687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.844970 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.846296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.847810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.854375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 43/85] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:19.854375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.858935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:19.859566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:19.859858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:19.860141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:19.860998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=723b2f68275d429fa7e2f11e555e86b2) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:19.861319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:19.862858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:19.876865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 43/86] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/role_assignments?user.id=723b2f68275d429fa7e2f11e555e86b2&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:19.876865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:19.969164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fb05-5696-4d95-9463-9f837e762a2f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:19.995686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753505-e41d-4d9a-bbe9-6f67b936c2e2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.010134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.010847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.011144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.011433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.012290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:20.012609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.014094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.025786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 44/87] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:20.026744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:20.035603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.036215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.036501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.036774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.110046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.112896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.141149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fa7de-4a6b-4283-96f9-7ab08c37f350 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.177772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.178396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.178694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.178983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.218138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 44/88] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:20.219329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:20.250802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.252937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.321324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8fcd-7eb7-4da8-a186-7dec7db1c639 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.355923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 45/89] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:20.356815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:20.359394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.360594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.361089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.361598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.363651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.365330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.367195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 45/90] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:20.368201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:20.478029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b85c-cbd5-42e2-bb89-d6e60f47483d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.486509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91e83-5827-47d5-9445-7f6df5fb0e74 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.514251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.515166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.515461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.515780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.517013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.518805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.520932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 46/91] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:20.527491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:20.536591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.537769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.538278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.538752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.541405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.543153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.545106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 46/92] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:20.546088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:20.642656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faea9a-bd43-4342-9f30-7406d88cc626 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.667902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.668465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.668760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.669049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.685188 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309886b5-0169-42ae-b8de-730675c6eac0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.729699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:20.730759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:20.731267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:20.731767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:20.732821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=f207ee062b9d45669b77905195363950) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:20.733337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.735108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.747517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:20.747517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:20.767538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 47/93] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/role_assignments?user.id=f207ee062b9d45669b77905195363950&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:20.768985 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:20.965163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a9b4-2443-4783-a102-f63655d4bfd8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:20.975079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 47/94] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:20.980614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:21.028779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:21.029456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:21.029742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:21.030020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:21.030857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] RBAC: Adding query filter params (role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=723b2f68275d429fa7e2f11e555e86b2) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:21.031169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:21.036838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:21.043182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 48/95] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/role_assignments?user.id=723b2f68275d429fa7e2f11e555e86b2&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:21.100690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4c0-daac-4ac8-ac5c-529f02f89a04 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:21.138315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01180f-a13c-4c42-ba94-c2d28a7ca42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:21.139613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01180f-a13c-4c42-ba94-c2d28a7ca42d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:21.140106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01180f-a13c-4c42-ba94-c2d28a7ca42d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:21.140602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01180f-a13c-4c42-ba94-c2d28a7ca42d None admin] PATH_INFO: `/v3/projects/b3acb7eea0ed43769e18705f553c3ae0` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:21.142065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01180f-a13c-4c42-ba94-c2d28a7ca42d None admin] RBAC: Authorizing `identity:get_project(project_id=b3acb7eea0ed43769e18705f553c3ae0)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:21.145163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01180f-a13c-4c42-ba94-c2d28a7ca42d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:21.147240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 48/96] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:20 2022] GET /identity/v3/projects/b3acb7eea0ed43769e18705f553c3ae0 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:21.156652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:21.291337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa78a48-3fb8-4106-9a18-d8ca1ec26128 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:21.328807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384df0c6-191c-4fee-b7de-432da07a0371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:21.329486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df0c6-191c-4fee-b7de-432da07a0371 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:21.329843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df0c6-191c-4fee-b7de-432da07a0371 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:21.330127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df0c6-191c-4fee-b7de-432da07a0371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:21.331063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384df0c6-191c-4fee-b7de-432da07a0371 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=b3acb7eea0ed43769e18705f553c3ae0, user.id=723b2f68275d429fa7e2f11e555e86b2) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:21.331386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384df0c6-191c-4fee-b7de-432da07a0371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:21.332917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384df0c6-191c-4fee-b7de-432da07a0371 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:21.339658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 49/97] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:21 2022] GET /identity/v3/role_assignments?user.id=723b2f68275d429fa7e2f11e555e86b2&scope.project.id=b3acb7eea0ed43769e18705f553c3ae0&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:23.172838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64104-a324-439f-97c2-7c39c83eed9d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.173403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64104-a324-439f-97c2-7c39c83eed9d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.173403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64104-a324-439f-97c2-7c39c83eed9d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.175321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 49/98] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:23.181119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa7a2-0724-4ee0-9b3c-a50e54043a99 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.181589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa7a2-0724-4ee0-9b3c-a50e54043a99 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.181680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa7a2-0724-4ee0-9b3c-a50e54043a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.200342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f63aa7a2-0724-4ee0-9b3c-a50e54043a99 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:23.201572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f63aa7a2-0724-4ee0-9b3c-a50e54043a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:23.273485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 50/99] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:23.308883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64104-a324-439f-97c2-7c39c83eed9d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:23.419596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64104-a324-439f-97c2-7c39c83eed9d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:23.427358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee41ff-5dfc-4fc9-853c-1de0cd6a84d6 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.427616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee41ff-5dfc-4fc9-853c-1de0cd6a84d6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.427894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee41ff-5dfc-4fc9-853c-1de0cd6a84d6 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.429533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 51/100] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:23.434336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92f725-9860-465c-8699-4deb9dee91b2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.434632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92f725-9860-465c-8699-4deb9dee91b2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.434915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92f725-9860-465c-8699-4deb9dee91b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.452906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bd92f725-9860-465c-8699-4deb9dee91b2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:23.454739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bd92f725-9860-465c-8699-4deb9dee91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:23.492069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:23.492898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.493183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.493461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.517555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:23.531946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 52/101] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:23.534194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:23.536007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:23.536959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 50/102] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:23.543401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92f725-9860-465c-8699-4deb9dee91b2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:23.562944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:23.651677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92f725-9860-465c-8699-4deb9dee91b2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:23.687506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae48436-7dbb-497c-be32-1a00d99ce0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:23.688140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae48436-7dbb-497c-be32-1a00d99ce0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.688433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae48436-7dbb-497c-be32-1a00d99ce0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.688720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae48436-7dbb-497c-be32-1a00d99ce0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.689603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae48436-7dbb-497c-be32-1a00d99ce0c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:23.690493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae48436-7dbb-497c-be32-1a00d99ce0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:23.691964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae48436-7dbb-497c-be32-1a00d99ce0c6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:23.702401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 53/103] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:23.708257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c72afd-ecad-4e37-a313-b672032281bf None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.708556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c72afd-ecad-4e37-a313-b672032281bf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.708841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c72afd-ecad-4e37-a313-b672032281bf None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.710309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 54/104] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:23.712957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c72afd-ecad-4e37-a313-b672032281bf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:23.809295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fd632-38d1-47c6-a511-5f7f413eaf4f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:23.852711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3bd9-cb82-4221-b3df-1274cf329687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:23.853541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3bd9-cb82-4221-b3df-1274cf329687 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.853826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3bd9-cb82-4221-b3df-1274cf329687 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.854105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3bd9-cb82-4221-b3df-1274cf329687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.878671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3bd9-cb82-4221-b3df-1274cf329687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-1efd3bd9-cb82-4221-b3df-1274cf329687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:23.886522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:23.887411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:23.888200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:23.894472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 51/105] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:23.895840 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9357-5d34-4c6f-814a-ecbcc760e3fc None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.896137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9357-5d34-4c6f-814a-ecbcc760e3fc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.896423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9357-5d34-4c6f-814a-ecbcc760e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.907762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c72afd-ecad-4e37-a313-b672032281bf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:23.916805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1aeb9357-5d34-4c6f-814a-ecbcc760e3fc None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:23.918374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1aeb9357-5d34-4c6f-814a-ecbcc760e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:23.943885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fce2f-6771-4896-95b6-797c29bc485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:23.944674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fce2f-6771-4896-95b6-797c29bc485a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.944963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fce2f-6771-4896-95b6-797c29bc485a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.945244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fce2f-6771-4896-95b6-797c29bc485a None admin] PATH_INFO: `/v3/users/fab8bd39d07d4db68d4b5422ac5170ce` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.962771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fce2f-6771-4896-95b6-797c29bc485a None admin] RBAC: Authorizing `identity:get_user(user_id=fab8bd39d07d4db68d4b5422ac5170ce)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:23.964663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fce2f-6771-4896-95b6-797c29bc485a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:23.966753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 55/106] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:23 2022] GET /identity/v3/users/fab8bd39d07d4db68d4b5422ac5170ce => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:23.968461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed6da6-70c9-4512-b004-964eff18794d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:23.968755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed6da6-70c9-4512-b004-964eff18794d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:23.969041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed6da6-70c9-4512-b004-964eff18794d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:23.971766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 56/107] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:23.972324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed6da6-70c9-4512-b004-964eff18794d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:23.992613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 52/108] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:23.999502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9357-5d34-4c6f-814a-ecbcc760e3fc None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.096865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed6da6-70c9-4512-b004-964eff18794d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.118211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9357-5d34-4c6f-814a-ecbcc760e3fc None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.140405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce63ba-485a-40b8-9a47-3957a06c3cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.141095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce63ba-485a-40b8-9a47-3957a06c3cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.141527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce63ba-485a-40b8-9a47-3957a06c3cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.141941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce63ba-485a-40b8-9a47-3957a06c3cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.143603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce63ba-485a-40b8-9a47-3957a06c3cc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:24.143920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce63ba-485a-40b8-9a47-3957a06c3cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.145880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce63ba-485a-40b8-9a47-3957a06c3cc3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.156295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.156517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 57/109] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:24.161826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052197-e762-4591-8667-700cef071cfb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.161826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052197-e762-4591-8667-700cef071cfb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.161826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052197-e762-4591-8667-700cef071cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.162968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.163479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.163963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.177275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1a052197-e762-4591-8667-700cef071cfb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:24.178478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1a052197-e762-4591-8667-700cef071cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:24.241936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.244228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.264031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 58/110] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:24.265035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052197-e762-4591-8667-700cef071cfb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.357059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 53/111] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:24.358353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.391986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052197-e762-4591-8667-700cef071cfb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.431481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.432310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.432595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.432876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.444090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:24.452150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:24.453052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:24.453794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:24.456389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 59/112] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:24.462175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.476985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9265-8c6e-4d4f-987e-751aa39a7c5b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.511636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.512440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.512737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.513018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.514255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.515779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.517752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 54/113] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:24 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:24.518543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.571531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d2390-987d-400c-b9c0-67d89beacbf3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.607767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038ccb-14c2-4544-9710-7679ad342e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.608584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038ccb-14c2-4544-9710-7679ad342e44 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.608870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038ccb-14c2-4544-9710-7679ad342e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.609153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038ccb-14c2-4544-9710-7679ad342e44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.610361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038ccb-14c2-4544-9710-7679ad342e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.612399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038ccb-14c2-4544-9710-7679ad342e44 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.614032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 60/114] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:24.615227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae03fa-52aa-45d4-be3b-618456013e0e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.615535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae03fa-52aa-45d4-be3b-618456013e0e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.615814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae03fa-52aa-45d4-be3b-618456013e0e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.619515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 61/115] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:24.619515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae03fa-52aa-45d4-be3b-618456013e0e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.640890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13522d2-6a22-4a3f-a4b9-d84e943cf9dd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.676023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.676907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.677200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.677486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.678819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.680333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.682056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 55/116] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:24 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:24.682832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.723003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae03fa-52aa-45d4-be3b-618456013e0e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.764126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.764747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.765039 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.765319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.766079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:24.766391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.768622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.777127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 62/117] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:24.777916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:24.808838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3f1b4-ce30-4624-9fab-ddf14fce2a08 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.842119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58477b-09e0-46f9-bcf8-ac066c068d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.842992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58477b-09e0-46f9-bcf8-ac066c068d48 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.843283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58477b-09e0-46f9-bcf8-ac066c068d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.843596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58477b-09e0-46f9-bcf8-ac066c068d48 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.844796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58477b-09e0-46f9-bcf8-ac066c068d48 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.846304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58477b-09e0-46f9-bcf8-ac066c068d48 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.848065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 56/118] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:24 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:24.849255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad8d9-9be4-4284-9cfb-39ad3bbf75bb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.849551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad8d9-9be4-4284-9cfb-39ad3bbf75bb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.849833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad8d9-9be4-4284-9cfb-39ad3bbf75bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.865961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-fd4ad8d9-9be4-4284-9cfb-39ad3bbf75bb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:24.867185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-fd4ad8d9-9be4-4284-9cfb-39ad3bbf75bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:24.876820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab1cda-ec82-4dc8-8377-0a0b0e7c3005 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:24.910518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca852b7-22c0-4a23-a3c8-b5a72e53cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:24.912125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca852b7-22c0-4a23-a3c8-b5a72e53cc14 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:24.912125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca852b7-22c0-4a23-a3c8-b5a72e53cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:24.912125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca852b7-22c0-4a23-a3c8-b5a72e53cc14 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:24.913385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca852b7-22c0-4a23-a3c8-b5a72e53cc14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:24.913924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca852b7-22c0-4a23-a3c8-b5a72e53cc14 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:24.933095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 57/119] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:24.933969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ad8d9-9be4-4284-9cfb-39ad3bbf75bb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.011526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 63/120] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:09:24 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:25.012821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78ce4-ef74-498f-9069-e5556da7c163 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.013116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78ce4-ef74-498f-9069-e5556da7c163 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.013404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78ce4-ef74-498f-9069-e5556da7c163 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.014840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 64/121] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:25.015547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78ce4-ef74-498f-9069-e5556da7c163 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.037656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ad8d9-9be4-4284-9cfb-39ad3bbf75bb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.081413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.082581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.083413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.084316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.085535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] RBAC: Adding query filter params (role.id=4ea125501d7a4f988a5d5781dce3beff, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=fab8bd39d07d4db68d4b5422ac5170ce) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:25.086342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:25.088480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:25.097671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 58/122] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:24 2022] GET /identity/v3/role_assignments?user.id=fab8bd39d07d4db68d4b5422ac5170ce&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=4ea125501d7a4f988a5d5781dce3beff => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:25.098853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.130134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78ce4-ef74-498f-9069-e5556da7c163 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.171101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.172359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.172792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.173210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] PATH_INFO: `/v3/users/f207ee062b9d45669b77905195363950` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.174774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f207ee062b9d45669b77905195363950)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:25.176363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:25.178179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 65/123] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:25 2022] GET /identity/v3/users/f207ee062b9d45669b77905195363950 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:25.178179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.246157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1926d-6305-4ae9-a003-b18469dbb7fc None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.285700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110a714-476a-444f-9dff-527df6f258de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.286982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a714-476a-444f-9dff-527df6f258de None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.287531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a714-476a-444f-9dff-527df6f258de None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.288016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a714-476a-444f-9dff-527df6f258de None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/723b2f68275d429fa7e2f11e555e86b2/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.290472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110a714-476a-444f-9dff-527df6f258de None admin] RBAC: Authorizing `identity:create_grant(project_id=5e4e4bb940334527ae5eccc044f5c39f, user_id=723b2f68275d429fa7e2f11e555e86b2, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:25.292299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110a714-476a-444f-9dff-527df6f258de None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:25.300576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6e5cb-4864-4cc6-8661-3815813f73f4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.336971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438f3a-9ec1-424a-9e0b-db231a862850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.337793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438f3a-9ec1-424a-9e0b-db231a862850 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.338081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438f3a-9ec1-424a-9e0b-db231a862850 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.338361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438f3a-9ec1-424a-9e0b-db231a862850 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.348975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7438f3a-9ec1-424a-9e0b-db231a862850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a7438f3a-9ec1-424a-9e0b-db231a862850 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:25.357128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:25.358015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:25.359267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 66/124] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:25.360149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384820-10f9-4811-a3f9-363f31fffd64 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.360427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384820-10f9-4811-a3f9-363f31fffd64 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.360587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384820-10f9-4811-a3f9-363f31fffd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.371504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 59/125] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:25 2022] PUT /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/723b2f68275d429fa7e2f11e555e86b2/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:25.372497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110a714-476a-444f-9dff-527df6f258de None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.404818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7f384820-10f9-4811-a3f9-363f31fffd64 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:25.406082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7f384820-10f9-4811-a3f9-363f31fffd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:25.550393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 67/126] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:25.551231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f384820-10f9-4811-a3f9-363f31fffd64 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.583198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110a714-476a-444f-9dff-527df6f258de None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.628639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.629525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.629810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.630091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.631340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:25.633011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:25.635067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 60/127] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:25 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:25.635767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.702043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f384820-10f9-4811-a3f9-363f31fffd64 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.745172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.745923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.746216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.746496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.747259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:25.747611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:25.754712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:25.760803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae177d-0701-4de5-8150-4cf0037265f6 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.763260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 68/128] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:25.764131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.801805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.802528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.802810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.803084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.813965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:25.822268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:25.823226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 61/129] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:25.824920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:25.929693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31067fdf-6a32-44ea-913d-a9b47a55792a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.964155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:25.965053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:25.965317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:25.965610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:25.966818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:25.967886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0d37-62a8-4ea6-b834-0bcd963e46f4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:25.968311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:25.969957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 62/130] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:25 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:25.970819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:26.045180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:26.046468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:26.046952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:26.047424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/f207ee062b9d45669b77905195363950/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:26.057229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e4e4bb940334527ae5eccc044f5c39f, user_id=f207ee062b9d45669b77905195363950, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:26.059023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:26.075757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7852f9a-a8b7-404e-bfe1-2742afd754c3 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:26.112460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:26.113225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:26.113512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:26.113791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:26.114565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:26.114874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:26.116369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:26.125829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 63/131] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:26.126452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:26.221889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 69/132] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:25 2022] PUT /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/f207ee062b9d45669b77905195363950/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:26.229246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:26.231223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cdda9-9621-4161-a9d6-2bc7cebcc929 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:26.269952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:26.270848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:26.271135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:26.271411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:26.272771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:26.274282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:26.276285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 64/133] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:26 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:26.282216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:26.396249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cd5b4-a6ff-434e-be34-62c6b2294076 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:26.432647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e04e54-c232-4518-98d3-fa59e18334c6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:26.443344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:26.444849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:26.445311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:26.445862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/723b2f68275d429fa7e2f11e555e86b2/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:26.457701 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e4e4bb940334527ae5eccc044f5c39f, user_id=723b2f68275d429fa7e2f11e555e86b2, role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:26.461033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:26.509503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:26.510433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:26.510718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:26.510995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:26.512502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:26.514040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:26.515903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 70/134] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:26 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:26.523920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:26.561186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 65/135] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:26 2022] PUT /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/723b2f68275d429fa7e2f11e555e86b2/roles/5656ec6c481b4cdf9cefe78698198023 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:26.677181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ecfa8-7a60-44e2-8c16-e356e2d1c9ec None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:26.713024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88c64d-2b8d-4af3-99b1-5b9879521866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:26.713938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c64d-2b8d-4af3-99b1-5b9879521866 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:26.714224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c64d-2b8d-4af3-99b1-5b9879521866 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:26.714505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c64d-2b8d-4af3-99b1-5b9879521866 None admin] PATH_INFO: `/v3/projects/b3acb7eea0ed43769e18705f553c3ae0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:26.715907 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88c64d-2b8d-4af3-99b1-5b9879521866 None admin] RBAC: Authorizing `identity:get_project(project_id=b3acb7eea0ed43769e18705f553c3ae0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:26.717407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88c64d-2b8d-4af3-99b1-5b9879521866 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:26.719256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 71/136] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:26 2022] GET /identity/v3/projects/b3acb7eea0ed43769e18705f553c3ae0 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:26.725672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:26.849659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c019-b26e-4cbe-8f09-dc52fef80405 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:26.894748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc267a-8db7-432a-9595-82ad7794e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:26.895680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc267a-8db7-432a-9595-82ad7794e79b None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:26.895971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc267a-8db7-432a-9595-82ad7794e79b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:26.896253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc267a-8db7-432a-9595-82ad7794e79b None admin] PATH_INFO: `/v3/projects/b3acb7eea0ed43769e18705f553c3ae0/users/723b2f68275d429fa7e2f11e555e86b2/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:26.900942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc267a-8db7-432a-9595-82ad7794e79b None admin] RBAC: Authorizing `identity:create_grant(project_id=b3acb7eea0ed43769e18705f553c3ae0, user_id=723b2f68275d429fa7e2f11e555e86b2, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:26.902442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc267a-8db7-432a-9595-82ad7794e79b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:26.977415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 66/137] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:26 2022] PUT /identity/v3/projects/b3acb7eea0ed43769e18705f553c3ae0/users/723b2f68275d429fa7e2f11e555e86b2/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:27.964367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe63ceb-fbf8-4d67-ac00-89ac77962ad3 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:27.964872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe63ceb-fbf8-4d67-ac00-89ac77962ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:27.964947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe63ceb-fbf8-4d67-ac00-89ac77962ad3 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:27.966623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 72/138] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:27.972790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d063a3-cf06-49d1-b2ed-1584faa07094 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:27.973256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d063a3-cf06-49d1-b2ed-1584faa07094 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:27.973332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d063a3-cf06-49d1-b2ed-1584faa07094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:27.996544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b6d063a3-cf06-49d1-b2ed-1584faa07094 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:27.997728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b6d063a3-cf06-49d1-b2ed-1584faa07094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:28.010665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec9541-235c-46a1-a0a7-4a81ed220242 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.010942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec9541-235c-46a1-a0a7-4a81ed220242 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.011158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec9541-235c-46a1-a0a7-4a81ed220242 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.012827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 73/139] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:28.035202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81257-2b79-49c2-b1c6-41ac53bb23ca None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.035521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81257-2b79-49c2-b1c6-41ac53bb23ca None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.035789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf81257-2b79-49c2-b1c6-41ac53bb23ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.079617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1cf81257-2b79-49c2-b1c6-41ac53bb23ca None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:28.079617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1cf81257-2b79-49c2-b1c6-41ac53bb23ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:28.108312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 67/140] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:28.187694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d063a3-cf06-49d1-b2ed-1584faa07094 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:28.188334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 74/141] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:28.229877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81257-2b79-49c2-b1c6-41ac53bb23ca None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:28.343602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf81257-2b79-49c2-b1c6-41ac53bb23ca None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:28.383203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d063a3-cf06-49d1-b2ed-1584faa07094 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:28.386806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:28.387650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.387936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.388213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.406149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:28.414393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:28.415278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:28.416081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 75/142] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:28.421966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:28.492199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:28.493023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.493316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.493601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.494832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:28.496302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:28.498099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 68/143] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:28.504409 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:28.530877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca59660-652b-43c9-888c-d4cfc9923d5e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:28.568281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:28.568955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.569239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.569520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.570278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:28.570587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:28.572019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:28.581990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 76/144] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:28.587703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:28.690059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215955d-3a75-4850-ad07-2303dbc4a4bd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:28.724805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:28.725695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.725980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.726253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] PATH_INFO: `/v3/users/fab8bd39d07d4db68d4b5422ac5170ce` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.727503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] RBAC: Authorizing `identity:get_user(user_id=fab8bd39d07d4db68d4b5422ac5170ce)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:28.728957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:28.735033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 77/145] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:28 2022] GET /identity/v3/users/fab8bd39d07d4db68d4b5422ac5170ce => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:28.736318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:28.762433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dafe25-55ae-4a6e-8123-9bf02b76714f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:28.824976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcc8cc-5a16-4de9-bad9-fa26756fe35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:28.825727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8cc-5a16-4de9-bad9-fa26756fe35f None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.825971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8cc-5a16-4de9-bad9-fa26756fe35f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.826257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8cc-5a16-4de9-bad9-fa26756fe35f None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.827007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcc8cc-5a16-4de9-bad9-fa26756fe35f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:28.828538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcc8cc-5a16-4de9-bad9-fa26756fe35f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:28.838928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb506-92af-48ab-bbe9-36aa5984970b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:28.875981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:28.877461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:28.877750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:28.878036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:28.879360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:28.880889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:28.882688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 78/146] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:28 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:28.888938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:28.964401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 69/147] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:09:28 2022] POST /identity/v3/users => generated 283 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:29.001123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c34555-9d39-4ec8-8ba7-99c5ad2b1b34 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:29.038244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0936fd-4dc5-49df-ad13-b5c3ecbd9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:29.039134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0936fd-4dc5-49df-ad13-b5c3ecbd9a9e None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:29.039412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0936fd-4dc5-49df-ad13-b5c3ecbd9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:29.039718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0936fd-4dc5-49df-ad13-b5c3ecbd9a9e None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/fab8bd39d07d4db68d4b5422ac5170ce/roles/4ea125501d7a4f988a5d5781dce3beff` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:29.041784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0936fd-4dc5-49df-ad13-b5c3ecbd9a9e None admin] RBAC: Authorizing `identity:create_grant(project_id=5e4e4bb940334527ae5eccc044f5c39f, user_id=fab8bd39d07d4db68d4b5422ac5170ce, role_id=4ea125501d7a4f988a5d5781dce3beff)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:29.043251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0936fd-4dc5-49df-ad13-b5c3ecbd9a9e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:29.091730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 79/148] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:28 2022] PUT /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/users/fab8bd39d07d4db68d4b5422ac5170ce/roles/4ea125501d7a4f988a5d5781dce3beff => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:09:29.253078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c8c9-3b6d-4b11-8162-0283425612d3 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:29.253574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c8c9-3b6d-4b11-8162-0283425612d3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:29.253574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c8c9-3b6d-4b11-8162-0283425612d3 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:29.255915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 70/149] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:29.261555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f9af-d1c3-4dab-91a6-c82cccb5718a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:29.261854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f9af-d1c3-4dab-91a6-c82cccb5718a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:29.262123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f9af-d1c3-4dab-91a6-c82cccb5718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:29.286383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3055f9af-d1c3-4dab-91a6-c82cccb5718a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:29.287604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3055f9af-d1c3-4dab-91a6-c82cccb5718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:29.364236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 80/150] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:29.400108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c8c9-3b6d-4b11-8162-0283425612d3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:29.546524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c8c9-3b6d-4b11-8162-0283425612d3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:29.595126 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:29.595918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:29.596207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:29.596485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:29.612382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:29.620374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:29.621336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:29.622115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 71/151] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:29.628155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f9af-d1c3-4dab-91a6-c82cccb5718a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:29.783599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f9af-d1c3-4dab-91a6-c82cccb5718a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:29.828591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517d4ff-5073-4cab-a368-455fcde7e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:29.829274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517d4ff-5073-4cab-a368-455fcde7e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:29.829555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517d4ff-5073-4cab-a368-455fcde7e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:29.829863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517d4ff-5073-4cab-a368-455fcde7e4f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:29.830641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517d4ff-5073-4cab-a368-455fcde7e4f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:29.830952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517d4ff-5073-4cab-a368-455fcde7e4f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:29.832356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517d4ff-5073-4cab-a368-455fcde7e4f6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:29.842238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 81/152] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:29.846784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:29.946044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7519-d842-4229-9051-516339ab9a27 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:29.946376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7519-d842-4229-9051-516339ab9a27 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:29.946593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7519-d842-4229-9051-516339ab9a27 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:29.949025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 82/153] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:29.953394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03852165-bb2d-4f04-972d-5d6d48fc7b64 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:29.953677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03852165-bb2d-4f04-972d-5d6d48fc7b64 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:29.953960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03852165-bb2d-4f04-972d-5d6d48fc7b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:29.977163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-03852165-bb2d-4f04-972d-5d6d48fc7b64 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:29.978350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-03852165-bb2d-4f04-972d-5d6d48fc7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:29.986481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f318c-437a-46b1-8369-4c876fea885e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.042834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.043768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.044058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.044340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.048380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:30.049932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:30.052114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 72/154] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:29 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:30.057664 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:30.091461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 83/155] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:30.126193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03852165-bb2d-4f04-972d-5d6d48fc7b64 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:30.160666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545faa7-6160-4833-b8d1-88e0ef72f62e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.212359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.213044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.213337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.213620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.255974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03852165-bb2d-4f04-972d-5d6d48fc7b64 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.294984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.295843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.296129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.296402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.298636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:30.300769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:30.317876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:30.325733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:30.327964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:30.330431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 84/156] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:30.337770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:30.404958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 73/157] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:30.410463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:30.472180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9d90-cd14-471d-9bd5-c6db6dbb8b1a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.513131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9e9db-99e0-43ec-b430-e436ad367f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.513659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187e7c6-df8a-4c29-83a2-e82f7f4bf46e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.513827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9e9db-99e0-43ec-b430-e436ad367f68 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.514130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9e9db-99e0-43ec-b430-e436ad367f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.514408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9e9db-99e0-43ec-b430-e436ad367f68 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.515165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9e9db-99e0-43ec-b430-e436ad367f68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:30.515504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9e9db-99e0-43ec-b430-e436ad367f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:30.517162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9e9db-99e0-43ec-b430-e436ad367f68 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:30.527928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 85/158] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:30.529394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ff99-ebce-40f0-86c3-38810a3a60e9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.529685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ff99-ebce-40f0-86c3-38810a3a60e9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.529961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ff99-ebce-40f0-86c3-38810a3a60e9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.531502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 86/159] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:30.532661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4533-2f0c-45a6-ad27-3733e6c9b311 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.533556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4533-2f0c-45a6-ad27-3733e6c9b311 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.533869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4533-2f0c-45a6-ad27-3733e6c9b311 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.539238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 87/160] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:30.540224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f4533-2f0c-45a6-ad27-3733e6c9b311 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:30.560926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94a6f8-d57b-4ab0-ae0d-1e3e3e234f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.561823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94a6f8-d57b-4ab0-ae0d-1e3e3e234f5a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.562112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94a6f8-d57b-4ab0-ae0d-1e3e3e234f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.562398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94a6f8-d57b-4ab0-ae0d-1e3e3e234f5a None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.568376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94a6f8-d57b-4ab0-ae0d-1e3e3e234f5a None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:30.569897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94a6f8-d57b-4ab0-ae0d-1e3e3e234f5a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:30.572085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 74/161] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:30 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:30.573351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f1cd-4f83-4707-ba39-aad897d549f7 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.573642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f1cd-4f83-4707-ba39-aad897d549f7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.573927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f1cd-4f83-4707-ba39-aad897d549f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.593342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1011f1cd-4f83-4707-ba39-aad897d549f7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:30.594609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1011f1cd-4f83-4707-ba39-aad897d549f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:30.667229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f4533-2f0c-45a6-ad27-3733e6c9b311 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.681296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 75/162] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:30.682750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995853-f1d9-4bec-9190-9c457905fb1d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.683049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995853-f1d9-4bec-9190-9c457905fb1d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.683326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995853-f1d9-4bec-9190-9c457905fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.713152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6e995853-f1d9-4bec-9190-9c457905fb1d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:30.716183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6e995853-f1d9-4bec-9190-9c457905fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:30.726442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.727750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.728208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.728707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] PATH_INFO: `/v3/users/f207ee062b9d45669b77905195363950` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.732075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] RBAC: Authorizing `identity:get_user(user_id=f207ee062b9d45669b77905195363950)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:30.733845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:30.735824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 88/163] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:30 2022] GET /identity/v3/users/f207ee062b9d45669b77905195363950 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:30.736960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:30.827565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 76/164] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:30.828886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e995853-f1d9-4bec-9190-9c457905fb1d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:30.943998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac41ed-7221-4f7e-a93c-68f0af1f7e9e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.951879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e995853-f1d9-4bec-9190-9c457905fb1d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:30.990636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.991891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.992384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:30.992866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:30.996886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:30.998707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:30.999535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:31.000014 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:31.001354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=723b2f68275d429fa7e2f11e555e86b2) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:31.001882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:31.004210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:31.006043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:31.014519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:31.015768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:31.016639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:31.019236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 77/165] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:31.020340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:31.022996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 89/166] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:30 2022] GET /identity/v3/role_assignments?user.id=723b2f68275d429fa7e2f11e555e86b2&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:31.024235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:31.130980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00282b-b678-4d76-9838-14ea6b89b1f2 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:31.172347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7d73-9f93-4f44-8d5d-aa0b5850ef90 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:31.186755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:31.187922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:31.188476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:31.188961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:31.220346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:31.221133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:31.221438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:31.221685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:31.237728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:31.254236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:31.255186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 90/167] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:31.259501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:31.272407 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:31.274331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:31.474119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331d4ee-7328-4517-ba1d-ca0a9ddcf2ba None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:31.478615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 78/168] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:31.479606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:31.556250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:31.556954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:31.557245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:31.557529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:31.558317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:31.558644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:31.560139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:31.574959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 91/169] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:31.575854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:31.631692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5675-6bb0-44c9-9d8a-0da8ecd81127 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:31.673980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:31.675131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:31.675659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:31.677324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:31.678340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:31.680223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:31.681926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:31.709397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 79/170] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:31.710288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:31.789409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964fa9-a227-46a8-a974-85b88d9400f8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:31.859203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:31.860465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:31.860953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:31.861461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:31.862909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:31.865228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:31.871615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 92/171] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:31 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:31.873900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:31.921246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980544-1f11-4be2-ad1a-3edaa593de4c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:31.992331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:31.993250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:31.993541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:31.993824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:31.995885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:31.998224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:32.000381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 80/172] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:31 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:32.000985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:32.115318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007905-7d59-4fe1-b0fe-eeea1c2f43a7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:32.200208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:32.201108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:32.201392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:32.201669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] PATH_INFO: `/v3/users/723b2f68275d429fa7e2f11e555e86b2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:32.202942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] RBAC: Authorizing `identity:get_user(user_id=723b2f68275d429fa7e2f11e555e86b2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:32.204426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:32.206387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 93/173] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:31 2022] GET /identity/v3/users/723b2f68275d429fa7e2f11e555e86b2 => generated 275 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:32.207171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:32.219355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b389d-ebcd-411e-a80b-3150d1f37102 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:32.285149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:32.285839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:32.286178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:32.286465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:32.287318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=f207ee062b9d45669b77905195363950) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:32.287663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:32.289143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:32.295754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 81/174] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:32 2022] GET /identity/v3/role_assignments?user.id=f207ee062b9d45669b77905195363950&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:32.296598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:32.408561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9557-6843-431b-937b-e589f4be06bc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:32.421140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b829f-a473-473d-b97a-71313f6b0b35 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:32.464482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:32.464998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:32.465196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:32.465462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:32.465747 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:32.466582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:32.467085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:32.467615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:32.592156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:32.598044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:32.604652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:32.606459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:32.803111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 82/175] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:32.808643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:32.844077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 94/176] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:32.849924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:32.978461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9347050-3777-4d19-837b-e234e7565a61 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:33.018487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:33.019287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.019599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.019885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.021266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:33.022841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:33.029746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 95/177] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:32 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:33.031093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:33.034750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241391-a3b4-4d19-bf51-ae503d4062f5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:33.089083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:33.089959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.090237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.090509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] PATH_INFO: `/v3/projects/b3acb7eea0ed43769e18705f553c3ae0` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.096279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] RBAC: Authorizing `identity:get_project(project_id=b3acb7eea0ed43769e18705f553c3ae0)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:33.097752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:33.099833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 83/178] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:32 2022] GET /identity/v3/projects/b3acb7eea0ed43769e18705f553c3ae0 => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:33.105538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:33.136474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9795422-9cee-4af1-b2a0-5a5ca3dcd320 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:33.171647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf4b6-4cee-4096-b19d-b519d609ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:33.172317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf4b6-4cee-4096-b19d-b519d609ad6d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.172605 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf4b6-4cee-4096-b19d-b519d609ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.172886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf4b6-4cee-4096-b19d-b519d609ad6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.173750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcf4b6-4cee-4096-b19d-b519d609ad6d None admin] RBAC: Adding query filter params (role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=723b2f68275d429fa7e2f11e555e86b2) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:33.174067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcf4b6-4cee-4096-b19d-b519d609ad6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:33.175538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcf4b6-4cee-4096-b19d-b519d609ad6d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:33.187612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 96/179] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:33 2022] GET /identity/v3/role_assignments?user.id=723b2f68275d429fa7e2f11e555e86b2&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:33.256599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc85af-9698-44ac-8c96-dce69b625eae None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:33.308604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080bc77-9e3e-40fa-861a-9bef199a46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:33.309199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080bc77-9e3e-40fa-861a-9bef199a46b1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.309490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080bc77-9e3e-40fa-861a-9bef199a46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.309765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080bc77-9e3e-40fa-861a-9bef199a46b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.310613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080bc77-9e3e-40fa-861a-9bef199a46b1 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=b3acb7eea0ed43769e18705f553c3ae0, user.id=723b2f68275d429fa7e2f11e555e86b2) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:33.310923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080bc77-9e3e-40fa-861a-9bef199a46b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:33.312422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080bc77-9e3e-40fa-861a-9bef199a46b1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:33.319600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 84/180] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:33 2022] GET /identity/v3/role_assignments?user.id=723b2f68275d429fa7e2f11e555e86b2&scope.project.id=b3acb7eea0ed43769e18705f553c3ae0&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:33.394951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423a935-fccf-4e8f-8ee6-d3724fc081c6 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.395669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423a935-fccf-4e8f-8ee6-d3724fc081c6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.395669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423a935-fccf-4e8f-8ee6-d3724fc081c6 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.397295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 97/181] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:33.406573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382702-e432-488b-86ab-67dd55287b41 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.406870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382702-e432-488b-86ab-67dd55287b41 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.407136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382702-e432-488b-86ab-67dd55287b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.431028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-cf382702-e432-488b-86ab-67dd55287b41 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:33.432276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cf382702-e432-488b-86ab-67dd55287b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:33.521377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 85/182] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:33.559443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423a935-fccf-4e8f-8ee6-d3724fc081c6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:33.685673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423a935-fccf-4e8f-8ee6-d3724fc081c6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:33.721995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb67b49-8f28-4537-b5a9-e9ed11e7f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:33.723246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb67b49-8f28-4537-b5a9-e9ed11e7f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.723827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb67b49-8f28-4537-b5a9-e9ed11e7f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.724361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb67b49-8f28-4537-b5a9-e9ed11e7f0f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.737119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb67b49-8f28-4537-b5a9-e9ed11e7f0f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5eb67b49-8f28-4537-b5a9-e9ed11e7f0f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:33.745549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:33.746491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:33.747279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:33.753118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 98/183] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:33.764687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382702-e432-488b-86ab-67dd55287b41 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:33.780771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830d0aa-e959-4389-80ee-7da80b2cbf71 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.781122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830d0aa-e959-4389-80ee-7da80b2cbf71 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.781422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830d0aa-e959-4389-80ee-7da80b2cbf71 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.783400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 99/184] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:33.790427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614cca-d5da-4d91-bf23-b53342b18d52 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.790843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614cca-d5da-4d91-bf23-b53342b18d52 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.790996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614cca-d5da-4d91-bf23-b53342b18d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.810631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-15614cca-d5da-4d91-bf23-b53342b18d52 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:33.811914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-15614cca-d5da-4d91-bf23-b53342b18d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:33.880389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382702-e432-488b-86ab-67dd55287b41 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:33.882345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 100/185] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:33.909045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614cca-d5da-4d91-bf23-b53342b18d52 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:33.919001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:33.919709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:33.920378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:33.920675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:33.921761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:33.922085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:33.924262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:33.941135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 86/186] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:33.946734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.023612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614cca-d5da-4d91-bf23-b53342b18d52 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.050455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34ae6-9d8f-4b8b-982e-de62f7efa4b8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.056098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bbf35-f4e6-4cda-81fd-bd268f79cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.056880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbf35-f4e6-4cda-81fd-bd268f79cae2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.057159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbf35-f4e6-4cda-81fd-bd268f79cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.057429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbf35-f4e6-4cda-81fd-bd268f79cae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.058593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bbf35-f4e6-4cda-81fd-bd268f79cae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:34.060060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bbf35-f4e6-4cda-81fd-bd268f79cae2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:34.061709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 101/187] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:34.062810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a68f1-f01d-4a3d-9e6f-bcd22603d216 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.063125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a68f1-f01d-4a3d-9e6f-bcd22603d216 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.063370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a68f1-f01d-4a3d-9e6f-bcd22603d216 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.065384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 102/188] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:34.066423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b4ea-f3c2-4b0c-adb8-5e70875e01c0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.066859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b4ea-f3c2-4b0c-adb8-5e70875e01c0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.066859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b4ea-f3c2-4b0c-adb8-5e70875e01c0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.068281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 103/189] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:34.068695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b4ea-f3c2-4b0c-adb8-5e70875e01c0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.088244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d7893-3aee-4b93-9960-7b73399b54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.089123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d7893-3aee-4b93-9960-7b73399b54ca None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.089410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d7893-3aee-4b93-9960-7b73399b54ca None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.089690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d7893-3aee-4b93-9960-7b73399b54ca None admin] PATH_INFO: `/v3/users/fab8bd39d07d4db68d4b5422ac5170ce` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.090886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d7893-3aee-4b93-9960-7b73399b54ca None admin] RBAC: Authorizing `identity:get_user(user_id=fab8bd39d07d4db68d4b5422ac5170ce)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:34.092390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d7893-3aee-4b93-9960-7b73399b54ca None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:34.094024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 87/190] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:33 2022] GET /identity/v3/users/fab8bd39d07d4db68d4b5422ac5170ce => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:34.095256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a349f-79ae-4747-9dec-674fa707f095 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.095569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a349f-79ae-4747-9dec-674fa707f095 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.095857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a349f-79ae-4747-9dec-674fa707f095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.111609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-983a349f-79ae-4747-9dec-674fa707f095 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:34.112798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-983a349f-79ae-4747-9dec-674fa707f095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:34.164750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b4ea-f3c2-4b0c-adb8-5e70875e01c0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.181991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 88/191] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:34.183922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe71b0-f4ec-4b4a-a3f4-bd40e2e7aada None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.184346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe71b0-f4ec-4b4a-a3f4-bd40e2e7aada None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.184754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe71b0-f4ec-4b4a-a3f4-bd40e2e7aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.200535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.201696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.202172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.202635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.203887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:34.205447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-dfbe71b0-f4ec-4b4a-a3f4-bd40e2e7aada None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:34.206057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:34.207233 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-dfbe71b0-f4ec-4b4a-a3f4-bd40e2e7aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:34.271413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 89/192] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:34.272295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe71b0-f4ec-4b4a-a3f4-bd40e2e7aada None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.337006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 104/193] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:09:34 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:34.337917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.370990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe71b0-f4ec-4b4a-a3f4-bd40e2e7aada None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.409393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.410057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.410340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.410616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.446365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a63d4-89ed-49e9-ad8f-2d84a980b4d7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.481157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:34.481686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.482492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.482670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:34.482766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.483036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.496032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:34.504328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:34.505286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:34.506081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 105/194] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:34.506828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.587616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 90/195] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:34.588257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.623696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e45a28-c562-4af5-b5a9-167dd6e7e12d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.665893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.666459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.666747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.667037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.679610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:34.687992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:34.688873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:34.690199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:34.693425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 106/196] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:34.693568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe28c6-1739-41a6-bff7-af853c5985a9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.693673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.729815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.730497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.730780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.731057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.731857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:34.732169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:34.733551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:34.742511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 91/197] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:34.743369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.807805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b379ab9-dda2-49f4-9180-06baea5dca29 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.855136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.856371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.856872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.857337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.858752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:34.860558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:34.862299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ff16-0f51-4609-a357-98b5b230c81d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:34.863096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 107/198] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:34.864095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.911107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:34.911849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:34.912123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:34.912404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:34.913187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:34.913707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:34.915681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:34.927286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 92/199] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:34.928336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:34.971222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf91f6-dcc7-4d87-bcb7-f930ff66afef None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.005467 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.006679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.007157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.007677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] PATH_INFO: `/v3/users/b8d48b8e1fbf4a1882093b487110eb6c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.030091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d48b8e1fbf4a1882093b487110eb6c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.032077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.038736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 108/200] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/users/b8d48b8e1fbf4a1882093b487110eb6c => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:35.039817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:35.044303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94fb2-7d53-4aed-8315-5b8e4e058872 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.081426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.082440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.082937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.083419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.084535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] RBAC: Adding query filter params (role.id=4ea125501d7a4f988a5d5781dce3beff, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f, user.id=fab8bd39d07d4db68d4b5422ac5170ce) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:35.085044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.086662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.092843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 93/201] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:34 2022] GET /identity/v3/role_assignments?user.id=fab8bd39d07d4db68d4b5422ac5170ce&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=4ea125501d7a4f988a5d5781dce3beff => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:35.093830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:35.206689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cc72-3fc8-4391-ac37-2b5ea59c6a31 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.274015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.275290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.275792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.276264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] PATH_INFO: `/v3/users/b8d48b8e1fbf4a1882093b487110eb6c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.278065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d48b8e1fbf4a1882093b487110eb6c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.281172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.285971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 109/202] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:35 2022] GET /identity/v3/users/b8d48b8e1fbf4a1882093b487110eb6c => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:35.292553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:35.296631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445bb15-c7e7-48c6-b30a-f8914fa7f7b5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.354511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.355176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.355484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.355771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.432248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58363a-2b80-4b9d-ad19-8c3846eedae2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.446764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.448956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.467795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.468405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.468658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.468935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.544126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.545629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.557397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 94/203] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:35.562976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:35.652278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 110/204] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:35.657533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:35.673238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96249f0d-1ea6-4159-a2bc-e4d7b41e06ee None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.746466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.747676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.748136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.748579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.755320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.757013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.758899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 95/205] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:35 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:35.765170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:35.817425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43cc9-f8d9-4f39-af5b-96c4f6a39ab8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.858061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.859086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.859370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.860034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.861451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.863344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.867557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 111/206] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:35 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:35.872119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:35.884326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fad08-e712-475b-b791-3123be490fe0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:35.926513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0394ea-0fbe-44b5-9c30-61cbd3900b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:35.927335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0394ea-0fbe-44b5-9c30-61cbd3900b08 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:35.927729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0394ea-0fbe-44b5-9c30-61cbd3900b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:35.928016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0394ea-0fbe-44b5-9c30-61cbd3900b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:35.929239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0394ea-0fbe-44b5-9c30-61cbd3900b08 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=b8d48b8e1fbf4a1882093b487110eb6c) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:35.929556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0394ea-0fbe-44b5-9c30-61cbd3900b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:35.931297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0394ea-0fbe-44b5-9c30-61cbd3900b08 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:35.939541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 96/207] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:35 2022] GET /identity/v3/role_assignments?user.id=b8d48b8e1fbf4a1882093b487110eb6c&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:35.991802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c46de-1966-4203-80d8-3b92af98b3c2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:36.029201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9fc62-125e-4d9d-b01a-41e1addfc788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:36.029952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9fc62-125e-4d9d-b01a-41e1addfc788 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:36.030244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9fc62-125e-4d9d-b01a-41e1addfc788 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:36.030526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9fc62-125e-4d9d-b01a-41e1addfc788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:36.031368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9fc62-125e-4d9d-b01a-41e1addfc788 None admin] RBAC: Adding query filter params (role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=b8d48b8e1fbf4a1882093b487110eb6c) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:36.031722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9fc62-125e-4d9d-b01a-41e1addfc788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:36.033875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9fc62-125e-4d9d-b01a-41e1addfc788 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:36.047563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 112/208] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:35 2022] GET /identity/v3/role_assignments?user.id=b8d48b8e1fbf4a1882093b487110eb6c&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:36.831549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e9cc6-d3c1-4fdb-8cb3-6c96bb0681fc None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:36.831871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e9cc6-d3c1-4fdb-8cb3-6c96bb0681fc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:36.832116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e9cc6-d3c1-4fdb-8cb3-6c96bb0681fc None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:36.833781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 97/209] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:36.841817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a06c-0f83-4987-90e0-4f64ee483ba1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:36.841817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a06c-0f83-4987-90e0-4f64ee483ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:36.841817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a06c-0f83-4987-90e0-4f64ee483ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:36.853498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8eef-2ff0-4ae5-b8c8-28b148f93495 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:36.853792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8eef-2ff0-4ae5-b8c8-28b148f93495 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:36.854072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8eef-2ff0-4ae5-b8c8-28b148f93495 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:36.855634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 98/210] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:36.858928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bd85a06c-0f83-4987-90e0-4f64ee483ba1 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:36.860722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52ac4-e39e-4397-96be-79554bd30269 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:36.861012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52ac4-e39e-4397-96be-79554bd30269 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:36.861291 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52ac4-e39e-4397-96be-79554bd30269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:36.861991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bd85a06c-0f83-4987-90e0-4f64ee483ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:36.881693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1bf52ac4-e39e-4397-96be-79554bd30269 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:36.882868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1bf52ac4-e39e-4397-96be-79554bd30269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:36.930279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 113/211] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:36.953759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a06c-0f83-4987-90e0-4f64ee483ba1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:36.961345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 99/212] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:36.985655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52ac4-e39e-4397-96be-79554bd30269 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:37.064567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a06c-0f83-4987-90e0-4f64ee483ba1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:37.090087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52ac4-e39e-4397-96be-79554bd30269 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:37.101428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:37.102580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:37.103070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:37.103587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:37.114747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:37.122860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:37.123755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:37.124559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:37.125662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:37.126122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:37.126945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:37.127222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:37.128329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 114/213] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:37.128524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:37.129959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:37.131705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 100/214] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:37.135527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:37.137533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:37.239710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8052-b02e-4964-a662-39fdf27d6c21 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:37.261444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc90f5-4674-4a19-8d1c-d7027027c360 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:37.277683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:37.279063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:37.279678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:37.280141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:37.281231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:37.281990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:37.283639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:37.294752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 115/215] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:37.300179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:37.300179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:37.300179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:37.300179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:37.300841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:37.301815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:37.302376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:37.405669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3790f-72bb-4429-a8fc-e0e82b51013e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:37.423833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 101/216] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:09:37 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:09:37.446978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:37.448513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:37.449048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:37.449553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] PATH_INFO: `/v3/users/2fb568638e6949b7b6cce6fc7d454f87` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:37.466254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] RBAC: Authorizing `identity:get_user(user_id=2fb568638e6949b7b6cce6fc7d454f87)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:37.468163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:37.470294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 116/217] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:37 2022] GET /identity/v3/users/2fb568638e6949b7b6cce6fc7d454f87 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:37.476441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:37.590828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c4799-0b4b-4dd8-80c6-d59668c7f7ae None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:37.627030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:37.628033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:37.628502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:37.628975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:37.701180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:37.703011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:37.821947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 102/218] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:37.827686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:37.929884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1831-5d81-41f5-a7ed-8ac66eaeb87c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:37.968024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa231e3-45ad-479a-8b1b-5a25524621a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:37.969229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa231e3-45ad-479a-8b1b-5a25524621a5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:37.969722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa231e3-45ad-479a-8b1b-5a25524621a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:37.970226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa231e3-45ad-479a-8b1b-5a25524621a5 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:37.971661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa231e3-45ad-479a-8b1b-5a25524621a5 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:37.973332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa231e3-45ad-479a-8b1b-5a25524621a5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:37.975558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 117/219] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:37 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:37.981285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:38.109569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bfe33-a02e-4456-9e67-fc6a042caeb3 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:38.161237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06439f6-2a8a-44ea-a812-360e6d7eb3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:38.162314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06439f6-2a8a-44ea-a812-360e6d7eb3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.162804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06439f6-2a8a-44ea-a812-360e6d7eb3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.163282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06439f6-2a8a-44ea-a812-360e6d7eb3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.164360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06439f6-2a8a-44ea-a812-360e6d7eb3c7 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=2fb568638e6949b7b6cce6fc7d454f87) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:38.164926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06439f6-2a8a-44ea-a812-360e6d7eb3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:38.166800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06439f6-2a8a-44ea-a812-360e6d7eb3c7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:38.177132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 103/220] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:37 2022] GET /identity/v3/role_assignments?user.id=2fb568638e6949b7b6cce6fc7d454f87&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:38.376870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51fae6-d485-4bd0-9bb7-d6ba24926718 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.377240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51fae6-d485-4bd0-9bb7-d6ba24926718 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.377441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51fae6-d485-4bd0-9bb7-d6ba24926718 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.378847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 118/221] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:38.384736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f8f3f-dd50-4c59-b0c1-a2e5126d9d08 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.385032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f8f3f-dd50-4c59-b0c1-a2e5126d9d08 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.385318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f8f3f-dd50-4c59-b0c1-a2e5126d9d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.402551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f89f8f3f-dd50-4c59-b0c1-a2e5126d9d08 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:38.403792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f89f8f3f-dd50-4c59-b0c1-a2e5126d9d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:38.419015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601de30a-3a37-4431-ab98-eaa42a79af62 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.419307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601de30a-3a37-4431-ab98-eaa42a79af62 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.419650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601de30a-3a37-4431-ab98-eaa42a79af62 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.421239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 119/222] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:38.427928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b013c-fd91-456b-929e-6328a7595420 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.428222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b013c-fd91-456b-929e-6328a7595420 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.428500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b013c-fd91-456b-929e-6328a7595420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.451805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-308b013c-fd91-456b-929e-6328a7595420 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:38.454601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-308b013c-fd91-456b-929e-6328a7595420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:38.489385 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 104/223] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:38.510913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f8f3f-dd50-4c59-b0c1-a2e5126d9d08 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:38.589798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 120/224] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:38.634595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b013c-fd91-456b-929e-6328a7595420 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:38.663593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f8f3f-dd50-4c59-b0c1-a2e5126d9d08 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:38.737093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:38.737974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.738264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.738544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.768121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:38.783337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:38.784347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:38.785134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 105/225] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:38.791634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:38.793864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b013c-fd91-456b-929e-6328a7595420 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:38.871817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:38.872636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.872926 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.873205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.896738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b9df9-6ca6-4a08-9e97-552008998da7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:38.911052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:38.918683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:38.920792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:38.922673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:38.928353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 121/226] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:38.930690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:38.931366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:38.931683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:38.931966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:38.932718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:38.933032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:38.934764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:38.935442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:38.943505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 106/227] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:38.949014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:39.060837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841812b-8443-4f19-a22e-a888735cd8d3 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:39.114129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:39.115022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:39.115307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:39.115610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] PATH_INFO: `/v3/users/b8d48b8e1fbf4a1882093b487110eb6c` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:39.117927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] RBAC: Authorizing `identity:get_user(user_id=b8d48b8e1fbf4a1882093b487110eb6c)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:39.119380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:39.126920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 107/228] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:38 2022] GET /identity/v3/users/b8d48b8e1fbf4a1882093b487110eb6c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:39.130154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:39.168205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7556f-0cfa-4b60-aeb0-e7a2e9119094 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:39.228796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:39.229473 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:39.229761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:39.230043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:39.230794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:39.231104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:39.232520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:39.248230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 122/229] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:39.248687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd6c-584d-47ed-8025-679be0b9aefd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:39.253990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:39.290881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:39.291784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:39.292071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:39.292353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:39.293557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:39.295027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:39.297015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 108/230] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:39 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:39.308414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:39.359202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984b510-b209-42ae-8830-dea9e98d37cb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:39.407090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:39.408961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:39.409448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:39.409921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] PATH_INFO: `/v3/users/b8d48b8e1fbf4a1882093b487110eb6c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:39.415964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d48b8e1fbf4a1882093b487110eb6c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:39.417704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:39.419956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 123/231] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:39 2022] GET /identity/v3/users/b8d48b8e1fbf4a1882093b487110eb6c => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:39.421691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b9c3-960f-4881-9700-18d5bda5e336 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:39.425758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:39.464749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:39.465653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:39.465943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:39.466223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/b8d48b8e1fbf4a1882093b487110eb6c/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:39.471246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] RBAC: Authorizing `identity:create_grant(project_id=109c2756e5b44414aa74c994e9b4b33f, user_id=b8d48b8e1fbf4a1882093b487110eb6c, role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:39.472975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:39.536869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9384b-05e2-4555-ada1-56a45fcd9768 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:39.565976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 109/232] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:39 2022] PUT /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/b8d48b8e1fbf4a1882093b487110eb6c/roles/5656ec6c481b4cdf9cefe78698198023 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:39.572049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4d937-acb0-428f-93c7-8ed2574bf1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:39.573317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d937-acb0-428f-93c7-8ed2574bf1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:39.573814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d937-acb0-428f-93c7-8ed2574bf1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:39.574271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d937-acb0-428f-93c7-8ed2574bf1b3 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:39.576001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4d937-acb0-428f-93c7-8ed2574bf1b3 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:39.577672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4d937-acb0-428f-93c7-8ed2574bf1b3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:39.580627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 124/233] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:39 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:39.586812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:39.707986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493334e-deb9-49ec-a0aa-25c8e4d87335 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:39.756837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c66b3c-e685-4ff7-b51c-b5223cf8cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:39.757759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c66b3c-e685-4ff7-b51c-b5223cf8cf52 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:39.758046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c66b3c-e685-4ff7-b51c-b5223cf8cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:39.758327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c66b3c-e685-4ff7-b51c-b5223cf8cf52 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/b8d48b8e1fbf4a1882093b487110eb6c/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:39.760515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c66b3c-e685-4ff7-b51c-b5223cf8cf52 None admin] RBAC: Authorizing `identity:create_grant(project_id=109c2756e5b44414aa74c994e9b4b33f, user_id=b8d48b8e1fbf4a1882093b487110eb6c, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:39.762047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c66b3c-e685-4ff7-b51c-b5223cf8cf52 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:39.862597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 110/234] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:39 2022] PUT /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/b8d48b8e1fbf4a1882093b487110eb6c/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:40.310750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc554e00-fdf5-41d1-a16b-4ec7d1448b70 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:40.311264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc554e00-fdf5-41d1-a16b-4ec7d1448b70 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:40.311341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc554e00-fdf5-41d1-a16b-4ec7d1448b70 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:40.312725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 125/235] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:40.318602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29057f6-cafa-4834-94b4-17bfb2d19fd0 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:40.319044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29057f6-cafa-4834-94b4-17bfb2d19fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:40.319222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29057f6-cafa-4834-94b4-17bfb2d19fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:40.336085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b29057f6-cafa-4834-94b4-17bfb2d19fd0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:40.336840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452f63b-ae8d-49c9-bf04-adf134e58bf2 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:40.337283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b29057f6-cafa-4834-94b4-17bfb2d19fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:40.337582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452f63b-ae8d-49c9-bf04-adf134e58bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:40.338057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452f63b-ae8d-49c9-bf04-adf134e58bf2 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:40.339925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 126/236] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:40.345465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d27d-f239-4fad-a5cb-37d3c991b7e5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:40.345753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d27d-f239-4fad-a5cb-37d3c991b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:40.346033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d27d-f239-4fad-a5cb-37d3c991b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:40.372431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6478d27d-f239-4fad-a5cb-37d3c991b7e5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:40.373614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6478d27d-f239-4fad-a5cb-37d3c991b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:40.406144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 111/237] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:40.430643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29057f6-cafa-4834-94b4-17bfb2d19fd0 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:40.474975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 127/238] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:40.514602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478d27d-f239-4fad-a5cb-37d3c991b7e5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:40.530179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29057f6-cafa-4834-94b4-17bfb2d19fd0 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:40.565898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:40.566627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:40.566917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:40.567198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:40.568699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:40.570153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:40.572277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 112/239] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:40.578379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:40.686965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546aa75-d76a-4943-9f7b-b75ea6e4f7f8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:40.722520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478d27d-f239-4fad-a5cb-37d3c991b7e5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:40.740343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:40.741042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:40.741329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:40.741605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:40.742331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:40.743832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:40.779248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:40.780358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:40.780783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:40.781204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:40.791583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:40.799680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:40.800752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:40.801740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:40.803972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 128/240] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:40.809369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:40.840568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 113/241] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:09:40 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:09:40.953382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2228fc-9a80-46ac-8ca3-9ddffa1554c6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:40.999208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9146ee6-ce70-4afa-9103-5d92d821903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:41.000235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146ee6-ce70-4afa-9103-5d92d821903b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.000666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146ee6-ce70-4afa-9103-5d92d821903b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.001088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146ee6-ce70-4afa-9103-5d92d821903b None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.002656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9146ee6-ce70-4afa-9103-5d92d821903b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:41.003107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9146ee6-ce70-4afa-9103-5d92d821903b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:41.004658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9146ee6-ce70-4afa-9103-5d92d821903b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:41.013826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 129/242] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:41.020675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:41.035776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d5c85-b252-4c61-970e-35ef9a46f9d2 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.036341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d5c85-b252-4c61-970e-35ef9a46f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.036770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d5c85-b252-4c61-970e-35ef9a46f9d2 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.040852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 130/243] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:41.044361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14de4a6-d886-4bc6-aaad-347af9a5a362 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.044885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14de4a6-d886-4bc6-aaad-347af9a5a362 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.046615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14de4a6-d886-4bc6-aaad-347af9a5a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.086067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d14de4a6-d886-4bc6-aaad-347af9a5a362 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:41.089976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d14de4a6-d886-4bc6-aaad-347af9a5a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:41.166530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57bb56-036f-422e-8534-4b73b75f4c7a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:41.205359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:41.206515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.206940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.207359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] PATH_INFO: `/v3/users/5a929fb454634b19a4187b94cf44afd4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.228556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] RBAC: Authorizing `identity:get_user(user_id=5a929fb454634b19a4187b94cf44afd4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:41.230026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:41.231271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 131/244] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:41.232350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 114/245] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:41 2022] GET /identity/v3/users/5a929fb454634b19a4187b94cf44afd4 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:41.244529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14de4a6-d886-4bc6-aaad-347af9a5a362 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:41.255146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:41.372873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14de4a6-d886-4bc6-aaad-347af9a5a362 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:41.382756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76ceb8-5bb4-47ef-9a40-a7ba6b817520 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:41.413981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:41.413981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.413981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.413981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.429214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:41.430330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.430792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.431758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.448614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:41.459950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:41.460848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:41.461628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:41.464511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 115/246] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:41.471014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:41.495113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:41.496622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:41.599586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04b57e-22ed-432b-a843-ae3e78247158 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:41.614410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 132/247] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:41.622075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:41.650257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:41.651602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.652222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.652880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.653846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:41.654377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:41.656068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:41.668792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 116/248] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:41.689744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:41.786842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd89f6-f5fc-41a4-9416-4f224ce46cd3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:41.864267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b9366-b449-4463-98a6-35297669464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:41.865266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b9366-b449-4463-98a6-35297669464e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:41.865554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b9366-b449-4463-98a6-35297669464e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:41.865834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b9366-b449-4463-98a6-35297669464e None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:41.867260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b9366-b449-4463-98a6-35297669464e None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:41.868750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b9366-b449-4463-98a6-35297669464e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:41.873381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 133/249] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:41 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:41.880693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b9366-b449-4463-98a6-35297669464e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:41.933503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8214305-2d53-4c84-8ff0-4639cec5a001 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:42.014326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:42.014326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.014326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.014326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] PATH_INFO: `/v3/users/2fb568638e6949b7b6cce6fc7d454f87` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.017275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb568638e6949b7b6cce6fc7d454f87)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:42.022221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:42.022221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 117/250] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:41 2022] GET /identity/v3/users/2fb568638e6949b7b6cce6fc7d454f87 => generated 297 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:42.028578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:42.086380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b9366-b449-4463-98a6-35297669464e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:42.168248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:42.169315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.169797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.170276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.171306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] RBAC: Adding query filter params (role.id=4ea125501d7a4f988a5d5781dce3beff, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=5a929fb454634b19a4187b94cf44afd4) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:42.171846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:42.179491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:42.179641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2c89-1853-40ca-b130-278d9b275af0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:42.197396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 134/251] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:41 2022] GET /identity/v3/role_assignments?user.id=5a929fb454634b19a4187b94cf44afd4&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=4ea125501d7a4f988a5d5781dce3beff => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:42.221904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d2a77-b12d-4196-97ec-a8dc3ad14a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:42.222795 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2a77-b12d-4196-97ec-a8dc3ad14a40 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.223080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2a77-b12d-4196-97ec-a8dc3ad14a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.223360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2a77-b12d-4196-97ec-a8dc3ad14a40 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.224907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d2a77-b12d-4196-97ec-a8dc3ad14a40 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:42.226376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d2a77-b12d-4196-97ec-a8dc3ad14a40 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:42.228346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 118/252] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:42 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:42.234319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:42.384003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d793fcd-bbbe-4ce1-b764-9649578c4c7f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:42.432277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc34978-3b8e-480f-8887-12bf74259446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:42.433534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34978-3b8e-480f-8887-12bf74259446 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.434038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34978-3b8e-480f-8887-12bf74259446 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.434510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34978-3b8e-480f-8887-12bf74259446 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/2fb568638e6949b7b6cce6fc7d454f87/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.438091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc34978-3b8e-480f-8887-12bf74259446 None admin] RBAC: Authorizing `identity:create_grant(project_id=109c2756e5b44414aa74c994e9b4b33f, user_id=2fb568638e6949b7b6cce6fc7d454f87, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:42.440354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc34978-3b8e-480f-8887-12bf74259446 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:42.522604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 135/253] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:42 2022] PUT /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/2fb568638e6949b7b6cce6fc7d454f87/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:42.658605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6689d-89d7-407a-a2f1-f19860a45018 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.659097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6689d-89d7-407a-a2f1-f19860a45018 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.659097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6689d-89d7-407a-a2f1-f19860a45018 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.661001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 119/254] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:42.666223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457f00-49cc-4100-bf11-6de1db5ef10c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.666575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457f00-49cc-4100-bf11-6de1db5ef10c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.666858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457f00-49cc-4100-bf11-6de1db5ef10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.728708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-eb457f00-49cc-4100-bf11-6de1db5ef10c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:42.729943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-eb457f00-49cc-4100-bf11-6de1db5ef10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:42.819623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 136/255] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:42.844957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6689d-89d7-407a-a2f1-f19860a45018 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:42.942686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6ffc-375a-4e5f-9346-b4aacba475a5 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.942976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6ffc-375a-4e5f-9346-b4aacba475a5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.943162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6ffc-375a-4e5f-9346-b4aacba475a5 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.944710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 137/256] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:42.949615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de2c8-5574-48a6-b9bf-581e80ec3bd2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:42.950144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de2c8-5574-48a6-b9bf-581e80ec3bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:42.950638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de2c8-5574-48a6-b9bf-581e80ec3bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:42.970623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6689d-89d7-407a-a2f1-f19860a45018 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:42.982675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-380de2c8-5574-48a6-b9bf-581e80ec3bd2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:42.983897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-380de2c8-5574-48a6-b9bf-581e80ec3bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:43.038963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:43.039816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:43.040105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:43.040829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:43.057440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:43.071048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:43.072041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:43.072828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:43.076217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 120/257] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:43.077925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:43.186198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 138/258] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:43.221780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380de2c8-5574-48a6-b9bf-581e80ec3bd2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:43.237942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d50b-4edc-48c8-8665-d130e3fff3d9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:43.271764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:43.272440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:43.272727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:43.273006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:43.273770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:43.274078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:43.275490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:43.284361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 121/259] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:43.292512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:43.457613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380de2c8-5574-48a6-b9bf-581e80ec3bd2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:43.467698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640c764-bea6-4b7f-bfd5-5daafa296ea5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:43.528700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:43.529781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:43.530078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:43.530452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] PATH_INFO: `/v3/users/b8d48b8e1fbf4a1882093b487110eb6c` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:43.531712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d48b8e1fbf4a1882093b487110eb6c)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:43.533994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:43.535711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 122/260] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:43 2022] GET /identity/v3/users/b8d48b8e1fbf4a1882093b487110eb6c => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:43.537810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:43.538602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:43.538886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:43.539161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:43.546437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:43.568118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:43.575878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:43.576779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:43.577581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 139/261] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:43.583416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:43.739339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455782c1-89b5-4f37-98de-f32a3c2f85c8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:43.776938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaa060-39c8-448c-bf5b-696087adf301 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:43.819367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:43.820412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:43.820698 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:43.820980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:43.821740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:43.822052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:43.823457 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:43.833937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 140/262] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:43.841122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:43.856594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:43.857258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:43.857541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:43.857819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:43.972976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:43.974472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:43.989338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13d66-e056-414d-b357-06894668aa4e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:44.046640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:44.047563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.048373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.048665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] PATH_INFO: `/v3/users/b8d48b8e1fbf4a1882093b487110eb6c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.052266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d48b8e1fbf4a1882093b487110eb6c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:44.053754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:44.055599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 141/263] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:43 2022] GET /identity/v3/users/b8d48b8e1fbf4a1882093b487110eb6c => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:44.061198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:44.078382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 123/264] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:09:44.086303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:44.281493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710ab5-6c50-4a59-ac4b-4a24992c8060 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:44.287051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da632de7-58d8-41ee-a80e-a5e989d34914 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:44.347125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:44.347947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.348232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.348510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.349979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:44.351443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:44.353165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 124/265] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:44 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:44.354500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:44.355212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.355520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.355801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.364464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:44.463226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:44.464733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:44.597888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb62151-5569-4885-ab8c-e93792f886d0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:44.605783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 142/266] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:44.614905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:44.684216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc85d7-b3e2-40bc-be83-2ee7595065d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:44.684902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc85d7-b3e2-40bc-be83-2ee7595065d2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.685193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc85d7-b3e2-40bc-be83-2ee7595065d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.685476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc85d7-b3e2-40bc-be83-2ee7595065d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.686320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc85d7-b3e2-40bc-be83-2ee7595065d2 None admin] RBAC: Adding query filter params (role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=b8d48b8e1fbf4a1882093b487110eb6c) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:44.686634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc85d7-b3e2-40bc-be83-2ee7595065d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:44.688136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc85d7-b3e2-40bc-be83-2ee7595065d2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:44.706031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 125/267] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:44 2022] GET /identity/v3/role_assignments?user.id=b8d48b8e1fbf4a1882093b487110eb6c&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:44.720876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5acc0-5ee8-4ca2-9a1a-a4b08cc14dc8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:44.759092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f08b6c-f7bf-46db-a240-20d9c0481b0d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.759994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f08b6c-f7bf-46db-a240-20d9c0481b0d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.767497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f08b6c-f7bf-46db-a240-20d9c0481b0d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.767692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:44.768590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.768880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.769159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.770615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 126/268] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:44.774899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:44.776487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:44.776613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca43eeb-80d3-4ea3-8c32-7578703d6fce None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.777133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca43eeb-80d3-4ea3-8c32-7578703d6fce None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.777620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca43eeb-80d3-4ea3-8c32-7578703d6fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.778373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 143/269] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:44 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:44.784922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:44.816651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4ca43eeb-80d3-4ea3-8c32-7578703d6fce None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:44.818282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4ca43eeb-80d3-4ea3-8c32-7578703d6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:44.966429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ff1e6-6988-4626-84ff-1684faeffc8d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:44.967944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 127/270] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:44.969358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8545895-945c-4eb2-8cf7-1f53b921273f None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.969671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8545895-945c-4eb2-8cf7-1f53b921273f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.969984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8545895-945c-4eb2-8cf7-1f53b921273f None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:44.975203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 128/271] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:44.976762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc895ed-1f95-4518-9407-bfea8638b482 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:44.977050 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc895ed-1f95-4518-9407-bfea8638b482 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:44.977327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc895ed-1f95-4518-9407-bfea8638b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.003288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bdc895ed-1f95-4518-9407-bfea8638b482 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:45.004526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bdc895ed-1f95-4518-9407-bfea8638b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:45.040789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:45.041465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.041751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.042036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.042881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=b8d48b8e1fbf4a1882093b487110eb6c) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:45.043190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:45.044766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:45.054756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 144/272] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:44 2022] GET /identity/v3/role_assignments?user.id=b8d48b8e1fbf4a1882093b487110eb6c&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:45.055653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:45.091099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 129/273] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 05 15:09:45.115905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc895ed-1f95-4518-9407-bfea8638b482 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:45.207675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc713b-1ee3-41e5-89b3-4cb6db40abb3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:45.248405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:45.249928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.250419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.250929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.252906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:45.254663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:45.257263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 145/274] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:45.262935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:45.326095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc895ed-1f95-4518-9407-bfea8638b482 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:45.366403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:45.367210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.367502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.367780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.378786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:45.389528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:45.390518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:45.392597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:45.393208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 130/275] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:45.398984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:45.449061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876254d1-af05-41a2-95a6-d94c4baa94a2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:45.491058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c626b-11a7-4fbc-82a8-decaa1d4d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:45.491737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c626b-11a7-4fbc-82a8-decaa1d4d218 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.492127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c626b-11a7-4fbc-82a8-decaa1d4d218 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.492469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c626b-11a7-4fbc-82a8-decaa1d4d218 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.493428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c626b-11a7-4fbc-82a8-decaa1d4d218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:45.494736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c626b-11a7-4fbc-82a8-decaa1d4d218 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:45.524515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0243ab-50fd-4c94-b867-8da3396b7e9d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:45.558177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:45.559092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.559352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.559681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.560420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:45.560733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:45.562197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:45.571709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 131/276] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:45.580474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:45.616534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 146/277] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:09:45 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:45.617873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e545ed6-998f-4a3c-9f1a-8cbd0c83e3ff None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.618163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e545ed6-998f-4a3c-9f1a-8cbd0c83e3ff None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.618443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e545ed6-998f-4a3c-9f1a-8cbd0c83e3ff None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.623538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 147/278] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:45.625821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851794b4-a961-40f6-ae05-e21504b46ce6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.626154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851794b4-a961-40f6-ae05-e21504b46ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.626432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851794b4-a961-40f6-ae05-e21504b46ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.664817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-851794b4-a961-40f6-ae05-e21504b46ce6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:45.666626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-851794b4-a961-40f6-ae05-e21504b46ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:45.708273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16943a-6949-4a04-915b-29915c86e0d8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:45.750132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:45.751229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.751657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.752008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] PATH_INFO: `/v3/users/edcc1e5be7a340029599c8aaf0abb950` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.753887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 148/279] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:45.771385 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=edcc1e5be7a340029599c8aaf0abb950)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:45.772913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:45.775103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 132/280] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:45 2022] GET /identity/v3/users/edcc1e5be7a340029599c8aaf0abb950 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:45.780980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851794b4-a961-40f6-ae05-e21504b46ce6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:45.785834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:45.897108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851794b4-a961-40f6-ae05-e21504b46ce6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:45.939110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:45.940005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:45.940290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:45.940563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:45.947154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcffb-b2f9-4621-b91c-2520b5641ab0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:45.953283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:45.963983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:45.964891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:45.965687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:45.966284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 149/281] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:45.972442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:46.003365 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:46.004394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.004855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.005306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.006312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, user.id=edcc1e5be7a340029599c8aaf0abb950, scope.system=all) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:46.006875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:46.008857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:46.016977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 133/282] 10.222.0.55 () {56 vars in 1308 bytes} [Thu May 5 15:09:45 2022] GET /identity/v3/role_assignments?user.id=edcc1e5be7a340029599c8aaf0abb950&scope.system=all&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:46.102517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb1b7-458f-4235-99fb-93b24f1d0c63 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:46.146125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab87c-ae90-482d-9a4a-78dc68b33328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:46.146832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab87c-ae90-482d-9a4a-78dc68b33328 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.147117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab87c-ae90-482d-9a4a-78dc68b33328 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.147416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab87c-ae90-482d-9a4a-78dc68b33328 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.148210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ab87c-ae90-482d-9a4a-78dc68b33328 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:46.148517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ab87c-ae90-482d-9a4a-78dc68b33328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:46.149920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ab87c-ae90-482d-9a4a-78dc68b33328 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:46.163837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 150/283] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:46.169548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:46.289796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0875e-3459-42c8-9c33-c88bf0637730 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.290117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0875e-3459-42c8-9c33-c88bf0637730 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.290355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0875e-3459-42c8-9c33-c88bf0637730 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.291745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 151/284] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:46.301157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c098e6-4428-4428-bcb8-5d709e3f202a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.302115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c098e6-4428-4428-bcb8-5d709e3f202a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.303335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c098e6-4428-4428-bcb8-5d709e3f202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.335384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9803b-59b3-428a-b5b6-3cae0437b966 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:46.335995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e9c098e6-4428-4428-bcb8-5d709e3f202a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:46.337235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e9c098e6-4428-4428-bcb8-5d709e3f202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:46.382100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:46.383381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.383902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.384898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] PATH_INFO: `/v3/users/5a929fb454634b19a4187b94cf44afd4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.386595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] RBAC: Authorizing `identity:get_user(user_id=5a929fb454634b19a4187b94cf44afd4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:46.388533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:46.391129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 134/285] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:46 2022] GET /identity/v3/users/5a929fb454634b19a4187b94cf44afd4 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:46.396426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:46.484946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 152/286] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:46.551954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eaa45-4ad0-48f5-8bcb-ae20874f1a95 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:46.552966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c098e6-4428-4428-bcb8-5d709e3f202a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:46.592399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:46.593262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.593540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.593810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.595925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:46.597372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:46.599281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 135/287] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:46 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:46.608398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:46.684849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c098e6-4428-4428-bcb8-5d709e3f202a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:46.725929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:46.726733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.727021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.727302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.746962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:46.758783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:46.759857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:46.760681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:46.764601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e39088-e6d3-4cb2-89a3-7bef6ad1a684 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:46.767522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 153/288] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:46.773953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:46.815956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:46.816874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.817162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.817442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/5a929fb454634b19a4187b94cf44afd4/roles/4ea125501d7a4f988a5d5781dce3beff` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.819542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] RBAC: Authorizing `identity:create_grant(project_id=109c2756e5b44414aa74c994e9b4b33f, user_id=5a929fb454634b19a4187b94cf44afd4, role_id=4ea125501d7a4f988a5d5781dce3beff)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:46.823522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:46.907486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833be029-4688-4661-b03c-d6b511bee7ba None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:46.932270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 136/289] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:09:46 2022] PUT /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f/users/5a929fb454634b19a4187b94cf44afd4/roles/4ea125501d7a4f988a5d5781dce3beff => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:46.947960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:46.949503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:46.950002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:46.958367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:46.960207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:46.960721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:46.962511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:46.972568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 154/290] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:46.978569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:47.111449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bbcb4-ded0-451f-9846-9f9816489de5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:47.166777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:47.168068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:47.168545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:47.169018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] PATH_INFO: `/v3/users/2fb568638e6949b7b6cce6fc7d454f87` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:47.170472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] RBAC: Authorizing `identity:get_user(user_id=2fb568638e6949b7b6cce6fc7d454f87)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:47.172176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:47.174933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 137/291] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:46 2022] GET /identity/v3/users/2fb568638e6949b7b6cce6fc7d454f87 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:47.180850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:47.305181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1640d3-8f79-4233-a54f-b8cf7ca9d47b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:47.339035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:47.339730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:47.340011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:47.340286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:47.457592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:47.459428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:47.601703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 155/292] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:47.607721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:47.744781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eda7aa-be25-43d6-869c-f5025acb7b5b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:47.818460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c55002-533a-4a61-a7ff-8acf946b26fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:47.820149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c55002-533a-4a61-a7ff-8acf946b26fb None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:47.820657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c55002-533a-4a61-a7ff-8acf946b26fb None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:47.821135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c55002-533a-4a61-a7ff-8acf946b26fb None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:47.822549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c55002-533a-4a61-a7ff-8acf946b26fb None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:47.824207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c55002-533a-4a61-a7ff-8acf946b26fb None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:47.831823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 138/293] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:47 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:47.831966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:47.981587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f992a-4764-4d80-8415-a85f22eacfb9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:48.015767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ca39a-c744-4d41-9a31-c02a642b63e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:48.017598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca39a-c744-4d41-9a31-c02a642b63e4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:48.018092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca39a-c744-4d41-9a31-c02a642b63e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:48.018573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca39a-c744-4d41-9a31-c02a642b63e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:48.019634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ca39a-c744-4d41-9a31-c02a642b63e4 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=2fb568638e6949b7b6cce6fc7d454f87) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:48.020177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ca39a-c744-4d41-9a31-c02a642b63e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:48.021841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ca39a-c744-4d41-9a31-c02a642b63e4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:48.029112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 156/294] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:47 2022] GET /identity/v3/role_assignments?user.id=2fb568638e6949b7b6cce6fc7d454f87&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:48.412312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a036d-bc57-48d6-9e9d-79a53db80158 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:48.412669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a036d-bc57-48d6-9e9d-79a53db80158 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:48.412982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a036d-bc57-48d6-9e9d-79a53db80158 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:48.414755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 139/295] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:48.421047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423290-0d9b-4272-a53c-27cd44563afd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:48.421367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423290-0d9b-4272-a53c-27cd44563afd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:48.421613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423290-0d9b-4272-a53c-27cd44563afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:48.442233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-21423290-0d9b-4272-a53c-27cd44563afd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:48.443416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-21423290-0d9b-4272-a53c-27cd44563afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:48.527418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 157/296] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:48.551733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a036d-bc57-48d6-9e9d-79a53db80158 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:48.678180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a036d-bc57-48d6-9e9d-79a53db80158 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:48.712574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e10c8-3b24-4108-afb5-faa00e761183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:48.713373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e10c8-3b24-4108-afb5-faa00e761183 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:48.713657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e10c8-3b24-4108-afb5-faa00e761183 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:48.713933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e10c8-3b24-4108-afb5-faa00e761183 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:48.725747 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e10c8-3b24-4108-afb5-faa00e761183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-e16e10c8-3b24-4108-afb5-faa00e761183 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:48.733712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:48.734671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:48.736067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:48.742311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 140/297] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:48.742615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21423290-0d9b-4272-a53c-27cd44563afd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:48.790733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b680ee-900f-4fac-9e05-f3776bdb2d8b None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:48.791139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b680ee-900f-4fac-9e05-f3776bdb2d8b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:48.791296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b680ee-900f-4fac-9e05-f3776bdb2d8b None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:48.792698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 141/298] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:48.798616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad51fe-1f86-4e50-bd96-81e75bb0d0d5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:48.798906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad51fe-1f86-4e50-bd96-81e75bb0d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:48.799190 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad51fe-1f86-4e50-bd96-81e75bb0d0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:48.819739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-36ad51fe-1f86-4e50-bd96-81e75bb0d0d5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:48.820965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-36ad51fe-1f86-4e50-bd96-81e75bb0d0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:48.848950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21423290-0d9b-4272-a53c-27cd44563afd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:48.884117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:48.884788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:48.885127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:48.885408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:48.886155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:48.886459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:48.887938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:48.901980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 158/299] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:48.902951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:48.907545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 142/300] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:48.933169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad51fe-1f86-4e50-bd96-81e75bb0d0d5 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.010959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a4655-2c3c-45e8-87ff-db7a74016326 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.034949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad51fe-1f86-4e50-bd96-81e75bb0d0d5 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.045083 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66e702-6ef9-4152-9dce-6b8c2950478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.046198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e702-6ef9-4152-9dce-6b8c2950478f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.046664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e702-6ef9-4152-9dce-6b8c2950478f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.046951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e702-6ef9-4152-9dce-6b8c2950478f None admin] PATH_INFO: `/v3/users/d61673d64d204265870f2c84558ec0a4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.063503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66e702-6ef9-4152-9dce-6b8c2950478f None admin] RBAC: Authorizing `identity:get_user(user_id=d61673d64d204265870f2c84558ec0a4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:49.065567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66e702-6ef9-4152-9dce-6b8c2950478f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:49.067654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 159/301] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:48 2022] GET /identity/v3/users/d61673d64d204265870f2c84558ec0a4 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:49.068934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede655c-aba5-4f78-a67e-17abba6ec0cb None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.069224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede655c-aba5-4f78-a67e-17abba6ec0cb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.069509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede655c-aba5-4f78-a67e-17abba6ec0cb None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.071519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 160/302] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:49.073041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede655c-aba5-4f78-a67e-17abba6ec0cb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.076547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604484-b083-468f-8356-5b6e9f7d5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.077483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604484-b083-468f-8356-5b6e9f7d5423 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.077776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604484-b083-468f-8356-5b6e9f7d5423 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.078060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604484-b083-468f-8356-5b6e9f7d5423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.079411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604484-b083-468f-8356-5b6e9f7d5423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:49.080931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604484-b083-468f-8356-5b6e9f7d5423 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:49.082701 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 143/303] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:49.084187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c429-ba60-41b6-aa82-b97ff929fb77 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.084480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c429-ba60-41b6-aa82-b97ff929fb77 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.084832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c429-ba60-41b6-aa82-b97ff929fb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.103213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3814c429-ba60-41b6-aa82-b97ff929fb77 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:49.104486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3814c429-ba60-41b6-aa82-b97ff929fb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:49.175284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 144/304] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:49.176163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c429-ba60-41b6-aa82-b97ff929fb77 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.197154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede655c-aba5-4f78-a67e-17abba6ec0cb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.230342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.231001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.231287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.231595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.232422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] RBAC: Adding query filter params (role.id=4ea125501d7a4f988a5d5781dce3beff, user.id=d61673d64d204265870f2c84558ec0a4, scope.system=all) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:49.232734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:49.234172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:49.239831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 161/305] 10.222.0.55 () {56 vars in 1308 bytes} [Thu May 5 15:09:49 2022] GET /identity/v3/role_assignments?user.id=d61673d64d204265870f2c84558ec0a4&scope.system=all&role.id=4ea125501d7a4f988a5d5781dce3beff => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:49.240623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.302169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c429-ba60-41b6-aa82-b97ff929fb77 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.349265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a2855-a417-4242-828b-3958a27ef2e7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.349513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.350147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.350435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.350718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] PATH_INFO: `/v3/groups` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.351423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:49.354123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:49.388625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.389447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.389747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.390011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.404058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:49.414419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:49.415369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:49.416854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 162/306] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:49.422180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.472508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 145/307] 10.222.0.55 () {60 vars in 1134 bytes} [Thu May 5 15:09:49 2022] POST /identity/v3/groups => generated 229 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:09:49.539668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f302202-9645-4eb6-b5b4-f1c8ef896c26 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.577872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80a52e-6c0d-4626-8b09-aea5a0b18ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.578698 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a52e-6c0d-4626-8b09-aea5a0b18ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.579581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a52e-6c0d-4626-8b09-aea5a0b18ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.579845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a52e-6c0d-4626-8b09-aea5a0b18ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.580625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a52e-6c0d-4626-8b09-aea5a0b18ce3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:49.580930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a52e-6c0d-4626-8b09-aea5a0b18ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:49.582384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a52e-6c0d-4626-8b09-aea5a0b18ce3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:49.591986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 163/308] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:49.597697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.623158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1ed46-d55a-459a-8a5c-7a631dbb363e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.623446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1ed46-d55a-459a-8a5c-7a631dbb363e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.623761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1ed46-d55a-459a-8a5c-7a631dbb363e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.625461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 164/309] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:49.631589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c901-802b-4f51-b1c3-443345a84526 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.631883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c901-802b-4f51-b1c3-443345a84526 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.632169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c901-802b-4f51-b1c3-443345a84526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.650998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7584c901-802b-4f51-b1c3-443345a84526 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:49.652297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7584c901-802b-4f51-b1c3-443345a84526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:49.714107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715e38-e025-4b02-804b-32a9cdd168ee None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.723789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 165/310] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:49.746436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c901-802b-4f51-b1c3-443345a84526 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.763414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.764376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.764656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.764988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] PATH_INFO: `/v3/users/edcc1e5be7a340029599c8aaf0abb950` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.768116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] RBAC: Authorizing `identity:get_user(user_id=edcc1e5be7a340029599c8aaf0abb950)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:49.769585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:49.771299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 146/311] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:49 2022] GET /identity/v3/users/edcc1e5be7a340029599c8aaf0abb950 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:49.784487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.872584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c901-802b-4f51-b1c3-443345a84526 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.895189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779023d6-c815-498e-9488-b8462b44f5dd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:49.907699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.908838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.908838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.909245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.920108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:49.928416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:49.929545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:49.930550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:49.932181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 166/312] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:49.937622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:49.941846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:49.943033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:49.943497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:49.943913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] PATH_INFO: `/v3/system/users/edcc1e5be7a340029599c8aaf0abb950/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:49.945552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=edcc1e5be7a340029599c8aaf0abb950, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:49.947116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:50.017016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 147/313] 10.222.0.55 () {58 vars in 1334 bytes} [Thu May 5 15:09:49 2022] PUT /identity/v3/system/users/edcc1e5be7a340029599c8aaf0abb950/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:09:50.050808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39aba6-c0ad-457b-9eb1-66b5d8c5b71a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:50.087919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:50.088852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:50.089295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:50.089728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:50.090647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:50.091103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:50.092724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:50.102586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 167/314] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:50.111128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:50.222433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b267-53ba-4615-98ef-be2da31ccee5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:50.260061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:50.260959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:50.261237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:50.261518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] PATH_INFO: `/v3/users/5a929fb454634b19a4187b94cf44afd4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:50.262727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] RBAC: Authorizing `identity:get_user(user_id=5a929fb454634b19a4187b94cf44afd4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:50.264230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:50.266434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 148/315] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:50 2022] GET /identity/v3/users/5a929fb454634b19a4187b94cf44afd4 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:50.271781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:50.377445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5b2d-4ff4-4b13-9e3d-d8457a8b4186 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:50.415213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:50.416252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:50.416732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:50.417200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:50.487395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:50.489245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:50.586924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 168/316] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:50.592567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:50.739920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8de77-2f1b-4d05-a061-1fb4173125b3 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:50.775855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6219795-95a0-4b84-8e3f-f8f70aef4c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:50.776726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219795-95a0-4b84-8e3f-f8f70aef4c00 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:50.777014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219795-95a0-4b84-8e3f-f8f70aef4c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:50.777294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219795-95a0-4b84-8e3f-f8f70aef4c00 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:50.778508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6219795-95a0-4b84-8e3f-f8f70aef4c00 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:50.779984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6219795-95a0-4b84-8e3f-f8f70aef4c00 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:50.782015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 149/317] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:50 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:50.788691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:50.892987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94544c0-4655-4705-a2f2-7a25b0be09e3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:50.930088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b42035-7d12-4450-9919-8a4242ef255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:50.931077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42035-7d12-4450-9919-8a4242ef255a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:50.931575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42035-7d12-4450-9919-8a4242ef255a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:50.932032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42035-7d12-4450-9919-8a4242ef255a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:50.933224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42035-7d12-4450-9919-8a4242ef255a None admin] RBAC: Adding query filter params (role.id=4ea125501d7a4f988a5d5781dce3beff, scope.project.id=109c2756e5b44414aa74c994e9b4b33f, user.id=5a929fb454634b19a4187b94cf44afd4) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:50.933736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42035-7d12-4450-9919-8a4242ef255a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:50.935356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42035-7d12-4450-9919-8a4242ef255a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:50.942755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 169/318] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:09:50 2022] GET /identity/v3/role_assignments?user.id=5a929fb454634b19a4187b94cf44afd4&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=4ea125501d7a4f988a5d5781dce3beff => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:51.544474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83400-6b87-4b72-81bf-0b67a27285cc None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:51.544991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83400-6b87-4b72-81bf-0b67a27285cc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:51.545097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83400-6b87-4b72-81bf-0b67a27285cc None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:51.546531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 150/319] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:51.551693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9ea30-d731-43b9-bc51-f1691ac34267 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:51.551987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9ea30-d731-43b9-bc51-f1691ac34267 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:51.552266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9ea30-d731-43b9-bc51-f1691ac34267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:51.568648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-70d9ea30-d731-43b9-bc51-f1691ac34267 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:51.569836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-70d9ea30-d731-43b9-bc51-f1691ac34267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:51.635505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 170/320] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:51.656862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e83400-6b87-4b72-81bf-0b67a27285cc None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:51.804609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e83400-6b87-4b72-81bf-0b67a27285cc None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:51.838392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:51.839197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:51.839517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:51.839799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:51.850225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:51.857954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:51.858814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:51.864062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 151/321] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:51.866512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:51.866631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5b323-e61d-4339-ac8a-68db9f8947ff None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:51.867031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5b323-e61d-4339-ac8a-68db9f8947ff None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:51.867099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5b323-e61d-4339-ac8a-68db9f8947ff None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:51.868581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 171/322] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:51.873521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582692ad-50f1-473e-b740-18836d479ab3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:51.873812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582692ad-50f1-473e-b740-18836d479ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:51.874088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582692ad-50f1-473e-b740-18836d479ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:51.892046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-582692ad-50f1-473e-b740-18836d479ab3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:51.893375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-582692ad-50f1-473e-b740-18836d479ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:51.967833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 172/323] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:51.977272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc88fe-23ec-4b22-9f8b-d34776c346ca None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:51.990232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582692ad-50f1-473e-b740-18836d479ab3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:52.012689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:52.013493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.013776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.014215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.015299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:52.016171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:52.018661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:52.032972 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 152/324] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:52.036060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:52.091536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582692ad-50f1-473e-b740-18836d479ab3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:52.129580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:52.130386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.130670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.130948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.132138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:52.133139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cacce-e808-4b47-b27e-5a436ac11734 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:52.133594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:52.135389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 173/325] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:09:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:52.140788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:52.166728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:52.167640 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.167925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.168198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] PATH_INFO: `/v3/users/d61673d64d204265870f2c84558ec0a4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.169461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] RBAC: Authorizing `identity:get_user(user_id=d61673d64d204265870f2c84558ec0a4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:52.170971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:52.173337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 153/326] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:52 2022] GET /identity/v3/users/d61673d64d204265870f2c84558ec0a4 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:52.178758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:52.253515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab880e-3e55-4595-9c4e-79049606580a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:52.282673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71706-14d5-4b3f-b003-6b4963f7b22b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:52.287555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb832595-2427-41a9-a917-485efd9207e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:52.288240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832595-2427-41a9-a917-485efd9207e4 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.288522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832595-2427-41a9-a917-485efd9207e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.288796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832595-2427-41a9-a917-485efd9207e4 None admin] PATH_INFO: `/v3/groups` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.289561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb832595-2427-41a9-a917-485efd9207e4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:52.291124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb832595-2427-41a9-a917-485efd9207e4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:52.317789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:52.318654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.318939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.319666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] PATH_INFO: `/v3/system/users/d61673d64d204265870f2c84558ec0a4/roles/4ea125501d7a4f988a5d5781dce3beff` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.320780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d61673d64d204265870f2c84558ec0a4, role_id=4ea125501d7a4f988a5d5781dce3beff)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:52.322158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:52.411581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 174/327] 10.222.0.55 () {60 vars in 1134 bytes} [Thu May 5 15:09:52 2022] POST /identity/v3/groups => generated 226 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:09:52.411581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6732-cc1e-48a8-80f5-0d244d538d7d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.411581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6732-cc1e-48a8-80f5-0d244d538d7d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.411581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6732-cc1e-48a8-80f5-0d244d538d7d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.411581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 175/328] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:52.412374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640bce7-f590-4a87-8ae5-dded8c882ef2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.412758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640bce7-f590-4a87-8ae5-dded8c882ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.413105 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640bce7-f590-4a87-8ae5-dded8c882ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.421604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 154/329] 10.222.0.55 () {58 vars in 1334 bytes} [Thu May 5 15:09:52 2022] PUT /identity/v3/system/users/d61673d64d204265870f2c84558ec0a4/roles/4ea125501d7a4f988a5d5781dce3beff => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:09:52.432617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5640bce7-f590-4a87-8ae5-dded8c882ef2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:52.433913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5640bce7-f590-4a87-8ae5-dded8c882ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:52.515536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 176/330] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:52.537428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:52.649143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b1284-d55f-4ff5-b888-1aa21e2e600d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:52.683385 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:52.684181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.684465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.684746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.695743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:52.703431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:52.704902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:52.705682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 155/331] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:52.711543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640bce7-f590-4a87-8ae5-dded8c882ef2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:52.815544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640bce7-f590-4a87-8ae5-dded8c882ef2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:52.859608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:52.860315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:52.860600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:52.860876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:52.861640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:52.861946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:52.863343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:52.872597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 177/332] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:52.878571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:52.981527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91323bba-f89a-4a1e-8bc5-46ea969acc82 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:53.017649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea516-e956-4c5e-bce0-2cf96ceabdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:53.018530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea516-e956-4c5e-bce0-2cf96ceabdff None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:53.018820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea516-e956-4c5e-bce0-2cf96ceabdff None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:53.019090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea516-e956-4c5e-bce0-2cf96ceabdff None admin] PATH_INFO: `/v3/users/edcc1e5be7a340029599c8aaf0abb950` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:53.020329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea516-e956-4c5e-bce0-2cf96ceabdff None admin] RBAC: Authorizing `identity:get_user(user_id=edcc1e5be7a340029599c8aaf0abb950)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:53.021802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea516-e956-4c5e-bce0-2cf96ceabdff None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:53.023789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 156/333] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:52 2022] GET /identity/v3/users/edcc1e5be7a340029599c8aaf0abb950 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:53.033334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:53.143326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f99c2-8c03-41fe-a370-c0a3f5dafd88 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:53.177881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e52a2f-ca53-4ca0-8c54-a077a709d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:53.178897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52a2f-ca53-4ca0-8c54-a077a709d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:53.179398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52a2f-ca53-4ca0-8c54-a077a709d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:53.179941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52a2f-ca53-4ca0-8c54-a077a709d7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:53.180976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e52a2f-ca53-4ca0-8c54-a077a709d7b7 None admin] RBAC: Adding query filter params (role.id=5520771cec5b4260bae84ce5d70ae39a, user.id=edcc1e5be7a340029599c8aaf0abb950, scope.system=all) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:53.181569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e52a2f-ca53-4ca0-8c54-a077a709d7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:53.183241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e52a2f-ca53-4ca0-8c54-a077a709d7b7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:53.206301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 178/334] 10.222.0.55 () {56 vars in 1308 bytes} [Thu May 5 15:09:53 2022] GET /identity/v3/role_assignments?user.id=edcc1e5be7a340029599c8aaf0abb950&scope.system=all&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:54.857798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be56e-535a-40c2-893a-432eaeff8662 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:54.858296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be56e-535a-40c2-893a-432eaeff8662 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:54.858371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be56e-535a-40c2-893a-432eaeff8662 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:54.859983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 157/335] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:54.865344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3c1d-482a-4a31-9bb7-41c324bb4116 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:54.866311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3c1d-482a-4a31-9bb7-41c324bb4116 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:54.866789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3c1d-482a-4a31-9bb7-41c324bb4116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:54.893044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e7ad3c1d-482a-4a31-9bb7-41c324bb4116 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:54.894695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e7ad3c1d-482a-4a31-9bb7-41c324bb4116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:54.970622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 179/336] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:55.011388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be56e-535a-40c2-893a-432eaeff8662 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:55.111310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648834d-d62c-472d-ab87-c6bb9ef141d8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.111633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648834d-d62c-472d-ab87-c6bb9ef141d8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.111920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648834d-d62c-472d-ab87-c6bb9ef141d8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.113510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 180/337] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:09:55.120098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175518e-78f2-419a-b548-bb6ffeb17eff None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.120674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175518e-78f2-419a-b548-bb6ffeb17eff None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.121155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175518e-78f2-419a-b548-bb6ffeb17eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.152493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0175518e-78f2-419a-b548-bb6ffeb17eff None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:55.154081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0175518e-78f2-419a-b548-bb6ffeb17eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:55.164272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be56e-535a-40c2-893a-432eaeff8662 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:55.247910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:55.248725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.249006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.249276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.268819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:55.277399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:55.278323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:09:55.279141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:55.283514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 158/338] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:55.290132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:55.315086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 181/339] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:09:55.353944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175518e-78f2-419a-b548-bb6ffeb17eff None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:55.469074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014f03-bac4-4823-ba92-41b733ae4d4a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:55.510622 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:55.511306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.511620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.511903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.512665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:55.512973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:55.514373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:55.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 159/340] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:55.534327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:55.573681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175518e-78f2-419a-b548-bb6ffeb17eff None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:55.655230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7b197-6cee-4bed-9fbb-4c53d3e05bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:55.656085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b197-6cee-4bed-9fbb-4c53d3e05bbb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.656371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b197-6cee-4bed-9fbb-4c53d3e05bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.656668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b197-6cee-4bed-9fbb-4c53d3e05bbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.678506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b197-6cee-4bed-9fbb-4c53d3e05bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-33f7b197-6cee-4bed-9fbb-4c53d3e05bbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:55.689797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:55.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:55.691591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:55.692694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 182/341] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:09:55.694513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee1ec-e399-4695-83c1-54008db1b705 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.694801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee1ec-e399-4695-83c1-54008db1b705 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.695073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee1ec-e399-4695-83c1-54008db1b705 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.704651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3251-46f0-4dfb-b2cc-7e71501714b1 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:55.709123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 183/342] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:55 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:55.709123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee1ec-e399-4695-83c1-54008db1b705 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:55.770191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ba50c-4563-4389-846c-ac2279265842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:55.771436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba50c-4563-4389-846c-ac2279265842 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.771916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba50c-4563-4389-846c-ac2279265842 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.772334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba50c-4563-4389-846c-ac2279265842 None admin] PATH_INFO: `/v3/users/d61673d64d204265870f2c84558ec0a4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.774660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ba50c-4563-4389-846c-ac2279265842 None admin] RBAC: Authorizing `identity:get_user(user_id=d61673d64d204265870f2c84558ec0a4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:55.776337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ba50c-4563-4389-846c-ac2279265842 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:55.778619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 160/343] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:09:55 2022] GET /identity/v3/users/d61673d64d204265870f2c84558ec0a4 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:55.780166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d39c5d-8212-49cf-b5f5-728275ba3c34 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.780657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d39c5d-8212-49cf-b5f5-728275ba3c34 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.781077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d39c5d-8212-49cf-b5f5-728275ba3c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.807223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-93d39c5d-8212-49cf-b5f5-728275ba3c34 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:55.808718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-93d39c5d-8212-49cf-b5f5-728275ba3c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:55.854141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee1ec-e399-4695-83c1-54008db1b705 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:55.905196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 161/344] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:55.906931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d39c5d-8212-49cf-b5f5-728275ba3c34 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:55.934291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:55.935597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:55.936080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:55.936546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:55.937442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:55.939839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:55.941498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:55.960423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 184/345] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:55.964470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:56.055450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d39c5d-8212-49cf-b5f5-728275ba3c34 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:56.100815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:56.101816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.102249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.102669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.103686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] RBAC: Adding query filter params (role.id=4ea125501d7a4f988a5d5781dce3beff, user.id=d61673d64d204265870f2c84558ec0a4, scope.system=all) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:56.104166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:56.105826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:56.105945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43909ad-58dd-48fa-8a42-07eabaf56cdd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:56.124010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 162/346] 10.222.0.55 () {56 vars in 1308 bytes} [Thu May 5 15:09:55 2022] GET /identity/v3/role_assignments?user.id=d61673d64d204265870f2c84558ec0a4&scope.system=all&role.id=4ea125501d7a4f988a5d5781dce3beff => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:56.131519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:56.146127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:56.146976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.147314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.150462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.159865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:56.171497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:56.173008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:56.173819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 185/347] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:56.179500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:56.288156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15d9dc-e406-4bc0-852f-eb4211ed5fc2 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:56.357228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49940bae-c5c0-4edf-8e0b-a0bdc379ccab None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:56.364289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048f054-b5e1-485c-a97d-574a95dab3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:56.365313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048f054-b5e1-485c-a97d-574a95dab3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.365845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048f054-b5e1-485c-a97d-574a95dab3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.366322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048f054-b5e1-485c-a97d-574a95dab3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.406028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161773-5792-4a79-a9ca-584afed0cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:56.407134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161773-5792-4a79-a9ca-584afed0cfec None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.407649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161773-5792-4a79-a9ca-584afed0cfec None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.408165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161773-5792-4a79-a9ca-584afed0cfec None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.409133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161773-5792-4a79-a9ca-584afed0cfec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:56.411106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161773-5792-4a79-a9ca-584afed0cfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:56.412830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161773-5792-4a79-a9ca-584afed0cfec None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:56.427369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 186/348] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:56.429131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c037bb0-6403-4a32-9c55-f91416fdd7ec None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.429653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c037bb0-6403-4a32-9c55-f91416fdd7ec None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.430138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c037bb0-6403-4a32-9c55-f91416fdd7ec None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.431809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 187/349] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:56.436559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c037bb0-6403-4a32-9c55-f91416fdd7ec None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:56.512185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048f054-b5e1-485c-a97d-574a95dab3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:56.514039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048f054-b5e1-485c-a97d-574a95dab3c1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:56.590241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c037bb0-6403-4a32-9c55-f91416fdd7ec None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:56.635403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:56.636044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.636387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.636671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.687231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 163/350] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:56.689247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d76b-3948-47ff-b8dd-8c134a4aee43 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.693221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d76b-3948-47ff-b8dd-8c134a4aee43 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.693516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d76b-3948-47ff-b8dd-8c134a4aee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.713099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-77a3d76b-3948-47ff-b8dd-8c134a4aee43 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:56.714949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-77a3d76b-3948-47ff-b8dd-8c134a4aee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:56.736524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:56.738071 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:56.816564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 164/351] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:56.817765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d76b-3948-47ff-b8dd-8c134a4aee43 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:56.849632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 188/352] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:56.850658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:56.939677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d76b-3948-47ff-b8dd-8c134a4aee43 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:56.982514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:56.983715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:56.984181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:56.984659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:56.985109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1931b6-9be1-433a-9acd-0f2df8b5a4a4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:56.987562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:56.989248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:56.991249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 165/353] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:56 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:56.992197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.026990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.028126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.029474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.029972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.043236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:57.052751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:57.053669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:09:57.054459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:57.057432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 189/354] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:57.058412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.107549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7328f9-dd33-4b37-b641-a786fd040329 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:57.144905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.146138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.146621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.147092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.148559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:57.150228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:57.153104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 166/355] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:56 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:57.154173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.188665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0fde3-96d4-4993-a8bf-226eb0da4826 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:57.232724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.233866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.234294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.234744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.241653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:57.243331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:57.245743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 190/356] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:57.246805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.282043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada96a-7530-4538-9571-55682caabe70 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:57.316957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.317914 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.318354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.318784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.319728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:57.320187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:57.321844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:57.332451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 167/357] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:57.333646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.353687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003952b-6a4a-4e16-aaae-86a3a9becb72 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:57.391757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.393023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.393488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.393942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.395402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:57.397095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:57.399333 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 191/358] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:57.400347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.449288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3379b0-eb57-4c86-b32e-e011be4e3998 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:57.493610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.494571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.494856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.495135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.496006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:57.496318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:57.497756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:57.504548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 168/359] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:57.506150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.521359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd084-e72f-4b3d-9e27-b82f8f51e77c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:57.570195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98d666-e1d5-4bf0-bfec-625b7ca25ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.570410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98d666-e1d5-4bf0-bfec-625b7ca25ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.570673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98d666-e1d5-4bf0-bfec-625b7ca25ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.570833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98d666-e1d5-4bf0-bfec-625b7ca25ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.650801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519387a6-ff28-4785-afcf-4434095d3756 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:57.667043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98d666-e1d5-4bf0-bfec-625b7ca25ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:57.668559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98d666-e1d5-4bf0-bfec-625b7ca25ee9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:57.700789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c678e6-cf32-4328-96d7-eac0195a72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:57.701466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c678e6-cf32-4328-96d7-eac0195a72c2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.701753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c678e6-cf32-4328-96d7-eac0195a72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.702029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c678e6-cf32-4328-96d7-eac0195a72c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.703028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c678e6-cf32-4328-96d7-eac0195a72c2 None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:57.703175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c678e6-cf32-4328-96d7-eac0195a72c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:57.704734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c678e6-cf32-4328-96d7-eac0195a72c2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:57.712239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 169/360] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:57.713654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101ba9-7781-49ee-8dd2-9f774a1ec4b2 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.713945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101ba9-7781-49ee-8dd2-9f774a1ec4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.714224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101ba9-7781-49ee-8dd2-9f774a1ec4b2 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.715915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 170/361] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:57.716949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba44a-27fa-46a9-9f64-32a11c68fcbf None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.717290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba44a-27fa-46a9-9f64-32a11c68fcbf None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.717512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba44a-27fa-46a9-9f64-32a11c68fcbf None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.719144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 171/362] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:09:57.723361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe920e-886b-45bc-b10c-9d5ecdc43a76 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.723718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe920e-886b-45bc-b10c-9d5ecdc43a76 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.723979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe920e-886b-45bc-b10c-9d5ecdc43a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.749668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4ebe920e-886b-45bc-b10c-9d5ecdc43a76 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:57.751404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4ebe920e-886b-45bc-b10c-9d5ecdc43a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:57.800608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 192/363] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:57.801744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c8a95-35f7-43ab-b4ba-8188b48b200b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:57.802101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c8a95-35f7-43ab-b4ba-8188b48b200b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:57.802294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c8a95-35f7-43ab-b4ba-8188b48b200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:57.820191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-746c8a95-35f7-43ab-b4ba-8188b48b200b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:09:57.821441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-746c8a95-35f7-43ab-b4ba-8188b48b200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:09:57.829853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 172/364] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:57.830742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe920e-886b-45bc-b10c-9d5ecdc43a76 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.894670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 193/365] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:09:57.895863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c8a95-35f7-43ab-b4ba-8188b48b200b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:57.972678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe920e-886b-45bc-b10c-9d5ecdc43a76 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.018362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.019438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.019752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.020209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.022086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:58.024220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:58.026857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 173/366] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:58.027941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:58.034905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c8a95-35f7-43ab-b4ba-8188b48b200b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.076874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.077985 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.078956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.079444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.093675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:58.102345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:58.103267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:09:58.104138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:09:58.106498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 194/367] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:09:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:58.107622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:58.149110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24cb6d-0eaf-4d1f-8176-7854ba2d5c94 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.192618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.194171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.194686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.195497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.209218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:09:58.217788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ad754-28e8-4982-a40f-5d39f8206ee9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:09:58.221694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:09:58.222820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:09:58.223942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:09:58.226328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 174/368] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:09:58.227278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:58.270868 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.273617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.273617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.273617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.275407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:58.276931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:58.278740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 195/369] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:58.279330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:58.357847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf830e3-cefe-49ee-ae9a-36b049859b63 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.396669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33149100-30d8-4909-895d-36a4f5f76c3f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.402511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.403499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.404019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.404578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.405577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:58.406089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:58.408138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:58.419348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 175/370] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:58.420955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:58.442032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.443334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.443870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.444360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.445756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:58.446276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:58.448194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:58.456788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 196/371] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:58.457837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:58.540216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd41057-1ffa-47ca-889a-abc9c859da4a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.582914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71b1d3-4def-4221-8b58-366d9fdb2669 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.587623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.588389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.588772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.589147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.590089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=109c2756e5b44414aa74c994e9b4b33f) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:58.590521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:58.592103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:58.598951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 176/372] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:58.599975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:58.628949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.630144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.631319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.632068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.722391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc614a-ff2b-426d-9ceb-0c6abe637c17 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:58.735158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:58.736876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:58.791578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:58.791578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:58.791578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:58.791578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:58.886519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:58.888783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:58.891833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 197/373] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:58.913005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:59.021640 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 177/374] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:09:59.027372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:59.053841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ede4b1-d9d7-463d-b770-99bb8b1f9aa4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:59.101787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:59.102660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:59.102942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:59.103218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:59.105502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:59.106989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:59.108893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 198/375] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:58 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:59.120490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:59.157103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318b6a3-2575-4982-809b-afe3da60d2ae None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:59.197904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:59.198774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:59.199058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:59.199337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] PATH_INFO: `/v3/projects/a3a7cd6436bd466e8794acccf97ede79` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:59.204132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] RBAC: Authorizing `identity:get_project(project_id=a3a7cd6436bd466e8794acccf97ede79)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:59.210565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:59.212390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 178/376] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:09:59 2022] GET /identity/v3/projects/a3a7cd6436bd466e8794acccf97ede79 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:59.217817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:59.335572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dc2d-0f3c-46c3-a8bd-cc76cd14db53 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:59.362197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac92e-1951-4fd9-b964-ed4828afcbfe None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:59.380752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:59.381624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:59.381911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:59.382194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] PATH_INFO: `/v3/groups/3d9f45df1dc44eb08a455a9223cf7b13` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:59.391296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] RBAC: Authorizing `identity:get_group(group_id=3d9f45df1dc44eb08a455a9223cf7b13)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:59.396152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:59.398277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 179/377] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:09:59 2022] GET /identity/v3/groups/3d9f45df1dc44eb08a455a9223cf7b13 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:59.403710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:59.437557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:59.438834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:59.439327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:59.439820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:59.442202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:59.443897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:59.446034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 199/378] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:09:59 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:09:59.451669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:09:59.511440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced63af-ceb1-4421-991f-328819bcda1d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:59.557230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339acc6d-68e3-4845-989b-902fba934545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:59.558224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339acc6d-68e3-4845-989b-902fba934545 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:59.558656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339acc6d-68e3-4845-989b-902fba934545 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:59.559096 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339acc6d-68e3-4845-989b-902fba934545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:59.560147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339acc6d-68e3-4845-989b-902fba934545 None admin] RBAC: Adding query filter params (group.id=3d9f45df1dc44eb08a455a9223cf7b13, role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=a3a7cd6436bd466e8794acccf97ede79) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:59.560639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339acc6d-68e3-4845-989b-902fba934545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:59.562330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339acc6d-68e3-4845-989b-902fba934545 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:59.575503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 180/379] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:09:59 2022] GET /identity/v3/role_assignments?group.id=3d9f45df1dc44eb08a455a9223cf7b13&scope.project.id=a3a7cd6436bd466e8794acccf97ede79&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:09:59.602829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7e833-eb2c-44c0-8573-498a744520e7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:09:59.645760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9585dd-fa6f-4764-a7ef-faba3d996958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:09:59.646441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9585dd-fa6f-4764-a7ef-faba3d996958 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:09:59.646723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9585dd-fa6f-4764-a7ef-faba3d996958 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:09:59.646997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9585dd-fa6f-4764-a7ef-faba3d996958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:09:59.647885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9585dd-fa6f-4764-a7ef-faba3d996958 None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=109c2756e5b44414aa74c994e9b4b33f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:09:59.648199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9585dd-fa6f-4764-a7ef-faba3d996958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:09:59.649664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9585dd-fa6f-4764-a7ef-faba3d996958 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:09:59.656259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 200/380] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:09:59 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:00.350429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8c473-07aa-4bdf-8d3a-ed7bd242700a None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:00.351481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8c473-07aa-4bdf-8d3a-ed7bd242700a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:00.352013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8c473-07aa-4bdf-8d3a-ed7bd242700a None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:00.353887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 181/381] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:00.359081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1dbc-d579-4c0e-9b76-76ab8cfce5cc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:00.360541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1dbc-d579-4c0e-9b76-76ab8cfce5cc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:00.361019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1dbc-d579-4c0e-9b76-76ab8cfce5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:00.388498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7c2c1dbc-d579-4c0e-9b76-76ab8cfce5cc None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:00.390061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7c2c1dbc-d579-4c0e-9b76-76ab8cfce5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:00.472820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 201/382] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:00.507524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8c473-07aa-4bdf-8d3a-ed7bd242700a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:00.591808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b47a5-b2db-4ad6-9ebe-8619f4db5e30 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:00.592447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b47a5-b2db-4ad6-9ebe-8619f4db5e30 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:00.592957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b47a5-b2db-4ad6-9ebe-8619f4db5e30 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:00.595097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 202/383] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:00.600871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab934d74-c7a4-47f5-834f-a641d685ceb5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:00.601436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab934d74-c7a4-47f5-834f-a641d685ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:00.601919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab934d74-c7a4-47f5-834f-a641d685ceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:00.634824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ab934d74-c7a4-47f5-834f-a641d685ceb5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:00.636036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ab934d74-c7a4-47f5-834f-a641d685ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:00.639326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8c473-07aa-4bdf-8d3a-ed7bd242700a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:00.693678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:00.695109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:00.695644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:00.696113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:00.721461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:00.729959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:00.730958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:00.731766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:00.742047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 182/384] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:00.748039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:00.775900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 203/385] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:00.818049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab934d74-c7a4-47f5-834f-a641d685ceb5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:00.914658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15805-ad70-401d-aa6b-9d4fb84dfc7d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:00.962774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:00.963452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:00.963799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:00.964082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:00.965804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:00.966116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:00.967596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:00.983631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 183/386] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:10:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:00.985297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:01.025910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab934d74-c7a4-47f5-834f-a641d685ceb5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.077590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.079308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.079800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.080307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.092267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:01.101378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:01.102294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:01.103094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:01.108179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 204/387] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:01.112109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0593487-812b-40a6-84a3-a7f37cfc0e41 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.114499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:01.154344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.155211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.155519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.155801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.157052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:01.158493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:01.161235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 184/388] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:00 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:01.167528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:01.227008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5b7b8-340e-407c-8070-a4e3719c49e4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.262953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.264029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.264522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.265000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.266285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:01.266845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:01.268462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:01.275855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b528c7-2dae-40d8-8145-81c0cb4f789b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.278287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 205/389] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:01.284498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:01.310405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.311258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.311556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.311828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.313639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:01.315080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:01.317077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 185/390] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:01 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:01.322998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:01.391739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870218a2-a645-48f6-9bc0-cabfa9bacd7b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.424463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c52a-6771-4f1b-a022-3c56f8a520a2 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.427328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.428478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.429042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.429521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.430996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:01.432717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:01.434955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 206/391] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:01 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:01.441367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:01.464976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.465866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.466348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.466764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.472945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e4e4bb940334527ae5eccc044f5c39f, group_id=33ae193e840241949d9c25af0bd3e1c3, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:01.474621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:01.555329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f8e1-ff8a-4b6f-b251-bf85ad59feb3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.568685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 186/392] 10.222.0.55 () {58 vars in 1442 bytes} [Thu May 5 15:10:01 2022] PUT /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:01.592457 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d91447-fead-453f-ba77-87b5e50ff409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.593333 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d91447-fead-453f-ba77-87b5e50ff409 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.593620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d91447-fead-453f-ba77-87b5e50ff409 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.594484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d91447-fead-453f-ba77-87b5e50ff409 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.595912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d91447-fead-453f-ba77-87b5e50ff409 None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:01.597389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d91447-fead-453f-ba77-87b5e50ff409 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:01.599563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 207/393] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:01 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:01.605519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:01.735450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10948-1c1d-42ec-8bdb-7d24669b2773 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:01.780212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9859a-95bc-4912-bdd9-ec929c394d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:01.781134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9859a-95bc-4912-bdd9-ec929c394d54 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.781456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9859a-95bc-4912-bdd9-ec929c394d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.781742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9859a-95bc-4912-bdd9-ec929c394d54 None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.786185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9859a-95bc-4912-bdd9-ec929c394d54 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e4e4bb940334527ae5eccc044f5c39f, group_id=33ae193e840241949d9c25af0bd3e1c3, role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:01.787678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9859a-95bc-4912-bdd9-ec929c394d54 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:01.869600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 187/394] 10.222.0.55 () {58 vars in 1442 bytes} [Thu May 5 15:10:01 2022] PUT /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5656ec6c481b4cdf9cefe78698198023 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:01.886036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ed5e-9dd2-4f26-9d09-d0b587f28db5 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.886388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ed5e-9dd2-4f26-9d09-d0b587f28db5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.886674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ed5e-9dd2-4f26-9d09-d0b587f28db5 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.888603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 208/395] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:01.895504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314650-b366-42d7-af0c-f158e4f8d561 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:01.895812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314650-b366-42d7-af0c-f158e4f8d561 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:01.896105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314650-b366-42d7-af0c-f158e4f8d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:01.917845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f8314650-b366-42d7-af0c-f158e4f8d561 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:01.919115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f8314650-b366-42d7-af0c-f158e4f8d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:02.013058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 188/396] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:02.036699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ed5e-9dd2-4f26-9d09-d0b587f28db5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:02.161177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ed5e-9dd2-4f26-9d09-d0b587f28db5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:02.201104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:02.201919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:02.202205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:02.202526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:02.217844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:02.225719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:02.226721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:02.227574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:02.231501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 209/397] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:02.236574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314650-b366-42d7-af0c-f158e4f8d561 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:02.358630 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314650-b366-42d7-af0c-f158e4f8d561 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:02.406085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3736b-7ece-4151-abeb-be35bfcd3d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:02.414478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3736b-7ece-4151-abeb-be35bfcd3d62 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:02.414478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3736b-7ece-4151-abeb-be35bfcd3d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:02.414478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3736b-7ece-4151-abeb-be35bfcd3d62 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:02.414478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3736b-7ece-4151-abeb-be35bfcd3d62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:02.414478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3736b-7ece-4151-abeb-be35bfcd3d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:02.414478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3736b-7ece-4151-abeb-be35bfcd3d62 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:02.422530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 189/398] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:10:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:02.428249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:02.471693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f50-e2cf-4461-adb2-d7a140e4eb9a None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:02.472196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f50-e2cf-4461-adb2-d7a140e4eb9a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:02.472299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f50-e2cf-4461-adb2-d7a140e4eb9a None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:02.474051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 190/399] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:10:02.484211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dfa3-ba29-4505-bfb7-a630b65d6811 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:02.485150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dfa3-ba29-4505-bfb7-a630b65d6811 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:02.485356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dfa3-ba29-4505-bfb7-a630b65d6811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:02.506962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3076dfa3-ba29-4505-bfb7-a630b65d6811 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:02.508184 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3076dfa3-ba29-4505-bfb7-a630b65d6811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:02.598634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b936f6-4fb6-4cee-9749-caf9aea4f066 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:02.658971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:02.659789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:02.660075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:02.660352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:02.661543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:02.663102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:02.665843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 210/400] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:02 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:02.669535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 191/401] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:02.672867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:02.693994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dfa3-ba29-4505-bfb7-a630b65d6811 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:02.802325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a055-a049-41ba-9cd1-a4fb3d1ed5d5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:02.821540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dfa3-ba29-4505-bfb7-a630b65d6811 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:02.847009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:02.848416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:02.849164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:02.849634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:02.852526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:02.854176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:02.856413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 211/402] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:02 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:02.864088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:02.888087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:02.889191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:02.889191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:02.889461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:02.914299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:02.927609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:02.928574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:02.929367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 192/403] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:02.938214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:03.010351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654271c-2f1f-4895-9940-a7634c70541a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.055634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.057290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.057773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.058269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.060826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] RBAC: Authorizing `identity:create_grant(project_id=109c2756e5b44414aa74c994e9b4b33f, group_id=33ae193e840241949d9c25af0bd3e1c3, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:03.063374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:03.107932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266e843-a929-486a-ab8b-8081eacf1a6f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.145414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9b5e7-0703-4609-9da4-bf13a1202592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.146538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9b5e7-0703-4609-9da4-bf13a1202592 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.147017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9b5e7-0703-4609-9da4-bf13a1202592 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.147572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9b5e7-0703-4609-9da4-bf13a1202592 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.148587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9b5e7-0703-4609-9da4-bf13a1202592 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:03.148895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9b5e7-0703-4609-9da4-bf13a1202592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:03.150327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9b5e7-0703-4609-9da4-bf13a1202592 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:03.161619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 193/404] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:03.162746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1980-29b5-4e7a-823f-51fc9572b2af None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.163264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1980-29b5-4e7a-823f-51fc9572b2af None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.163367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1980-29b5-4e7a-823f-51fc9572b2af None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.168483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 194/405] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:03.172666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 212/406] 10.222.0.55 () {58 vars in 1442 bytes} [Thu May 5 15:10:02 2022] PUT /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:10:03.177706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f98c-729c-450a-9dee-daf47d51bdbd None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.183074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:03.183212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f98c-729c-450a-9dee-daf47d51bdbd None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.183212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f98c-729c-450a-9dee-daf47d51bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.208657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8091f98c-729c-450a-9dee-daf47d51bdbd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:03.210147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8091f98c-729c-450a-9dee-daf47d51bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:03.291222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514813-fe2f-40bc-a864-33c11bea228e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.339499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 195/407] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:03.341354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.342434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.342900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.343320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.348451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:03.350200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:03.352597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 213/408] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:03 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:03.358687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f98c-729c-450a-9dee-daf47d51bdbd None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:03.371183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:03.481736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d2bf-dfad-49ad-ba4e-276e06ec1070 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.521606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.522647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.523164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.523628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.527566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f98c-729c-450a-9dee-daf47d51bdbd None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.535138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:03.542934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:03.543872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:03.544658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:03.551577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 214/409] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:03.553978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:03.569547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.570534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.570879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.571331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.572787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:03.574167 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:03.576105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 196/410] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:03 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:03.586332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:03.693328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a701ae-07d8-4889-b512-42ca4f7b8f25 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.766132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.766815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.767094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.767370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.768142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:03.768448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:03.769817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:03.773227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc944-cd22-4128-ac2a-8109735b8842 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.789555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 215/411] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:03.796330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:03.842308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.843201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.843496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.843811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.849252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] RBAC: Authorizing `identity:create_grant(project_id=109c2756e5b44414aa74c994e9b4b33f, group_id=33ae193e840241949d9c25af0bd3e1c3, role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:03.850704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:03.935331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026f1b9-96b9-4d57-bf28-e26cc74581cc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:03.946891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 197/412] 10.222.0.55 () {58 vars in 1442 bytes} [Thu May 5 15:10:03 2022] PUT /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f/groups/33ae193e840241949d9c25af0bd3e1c3/roles/5656ec6c481b4cdf9cefe78698198023 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:10:03.971795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:03.972693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:03.973005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:03.973292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] PATH_INFO: `/v3/groups/3d9f45df1dc44eb08a455a9223cf7b13` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:03.974608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] RBAC: Authorizing `identity:get_group(group_id=3d9f45df1dc44eb08a455a9223cf7b13)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:03.976129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:03.978183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 216/413] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:03 2022] GET /identity/v3/groups/3d9f45df1dc44eb08a455a9223cf7b13 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:03.983752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:04.137488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be2dde-4ad3-4704-b912-9f576c73bd9b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:04.181515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58273a2b-b318-4738-8d41-559a3e17fab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:04.182392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58273a2b-b318-4738-8d41-559a3e17fab9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:04.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58273a2b-b318-4738-8d41-559a3e17fab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:04.182951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58273a2b-b318-4738-8d41-559a3e17fab9 None admin] PATH_INFO: `/v3/projects/a3a7cd6436bd466e8794acccf97ede79` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:04.184173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58273a2b-b318-4738-8d41-559a3e17fab9 None admin] RBAC: Authorizing `identity:get_project(project_id=a3a7cd6436bd466e8794acccf97ede79)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:04.185627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58273a2b-b318-4738-8d41-559a3e17fab9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:04.188262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 198/414] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:03 2022] GET /identity/v3/projects/a3a7cd6436bd466e8794acccf97ede79 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:04.196604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:04.307613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b07b-be5c-41a6-ab0a-24cd43284446 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:04.347259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df36b-7d93-4a32-b557-fb92fb0c9fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:04.348200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df36b-7d93-4a32-b557-fb92fb0c9fd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:04.348487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df36b-7d93-4a32-b557-fb92fb0c9fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:04.348769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df36b-7d93-4a32-b557-fb92fb0c9fd8 None admin] PATH_INFO: `/v3/projects/a3a7cd6436bd466e8794acccf97ede79/groups/3d9f45df1dc44eb08a455a9223cf7b13/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:04.350829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df36b-7d93-4a32-b557-fb92fb0c9fd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3a7cd6436bd466e8794acccf97ede79, group_id=3d9f45df1dc44eb08a455a9223cf7b13, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:04.352318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df36b-7d93-4a32-b557-fb92fb0c9fd8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:04.428443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 217/415] 10.222.0.55 () {58 vars in 1442 bytes} [Thu May 5 15:10:04 2022] PUT /identity/v3/projects/a3a7cd6436bd466e8794acccf97ede79/groups/3d9f45df1dc44eb08a455a9223cf7b13/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:04.846084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519b912-f362-42b0-a665-74fe59edb27d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:04.846596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519b912-f362-42b0-a665-74fe59edb27d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:04.846700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519b912-f362-42b0-a665-74fe59edb27d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:04.848020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 199/416] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:04.853305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b527-251a-48b7-82da-47f580d27c29 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:04.853714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b527-251a-48b7-82da-47f580d27c29 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:04.853881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b527-251a-48b7-82da-47f580d27c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:04.876551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f460b527-251a-48b7-82da-47f580d27c29 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:04.877769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f460b527-251a-48b7-82da-47f580d27c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:04.940379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa723-a877-400e-93df-4f679b5bb987 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:04.942989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa723-a877-400e-93df-4f679b5bb987 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:04.942989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa723-a877-400e-93df-4f679b5bb987 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:04.943829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 200/417] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:04.949074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033f19-7e68-450d-b7d9-031a22a40e08 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:04.949074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033f19-7e68-450d-b7d9-031a22a40e08 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:04.949074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033f19-7e68-450d-b7d9-031a22a40e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:04.966322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 218/418] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:04.983767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f6033f19-7e68-450d-b7d9-031a22a40e08 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:04.985566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f6033f19-7e68-450d-b7d9-031a22a40e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:05.006028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460b527-251a-48b7-82da-47f580d27c29 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.101394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 201/419] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:05.106464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460b527-251a-48b7-82da-47f580d27c29 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:05.141219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6033f19-7e68-450d-b7d9-031a22a40e08 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.142962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:05.143811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:05.144125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:05.144370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:05.155293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:05.163428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:05.165610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:05.167584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 219/420] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:05.171103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.279853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece50fa-7451-4286-8955-8717581dd4d6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:05.322138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:05.322855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:05.323127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:05.323406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:05.329549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:05.329549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:05.329549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:05.345266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 220/421] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:05.345987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6033f19-7e68-450d-b7d9-031a22a40e08 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:05.352903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.389195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:05.390031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:05.391662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:05.391949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:05.405078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:05.414604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:05.415561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:05.416451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 202/422] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:05.422829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.514738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8967a-4acd-4d64-88d5-254f31c2c759 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:05.553200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:05.553778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:05.554055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:05.554331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:05.597347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937e0c6-5207-45b8-988b-e5cc58ac6e77 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:05.649415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:05.650864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:05.681173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:05.681864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:05.682151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:05.682431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:05.683203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:05.683534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:05.684971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:05.705770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 203/423] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:05.711505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.754644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 221/424] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:10:05.762112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.860598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79505-2f87-4c46-af32-dfd3936459c9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:05.896080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:05.896943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:05.897224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:05.897497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:05.902851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:05.904350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:05.906814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 222/425] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:05.914523 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:05.955158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f909b-ddb1-47db-90ed-640473d1db48 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.019631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.020310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.020598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.020873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.048495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4572-f6df-4fc9-b0df-e77e716c1f2c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.083968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.084834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.085111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.085379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.086605 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:06.088098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:06.094666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 223/426] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:06.096005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:06.164478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:06.166318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:06.200838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16067ede-73ce-4788-ba84-dd113c1644fc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.237167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb8b08-c8eb-4ead-893a-18ff352935dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.237832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb8b08-c8eb-4ead-893a-18ff352935dc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.238110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb8b08-c8eb-4ead-893a-18ff352935dc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.238387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb8b08-c8eb-4ead-893a-18ff352935dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.239256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb8b08-c8eb-4ead-893a-18ff352935dc None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:06.239607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb8b08-c8eb-4ead-893a-18ff352935dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:06.241102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb8b08-c8eb-4ead-893a-18ff352935dc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:06.247725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 224/427] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:10:06 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:06.257070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2a32c-f380-497c-85f9-b52c6480b80e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.257417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2a32c-f380-497c-85f9-b52c6480b80e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.257630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2a32c-f380-497c-85f9-b52c6480b80e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.263155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 225/428] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:06.264899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c2f6-2e1f-45ce-818e-9590d818d7e0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.265189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c2f6-2e1f-45ce-818e-9590d818d7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.265772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c2f6-2e1f-45ce-818e-9590d818d7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.304644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e541c2f6-2e1f-45ce-818e-9590d818d7e0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:06.305868 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e541c2f6-2e1f-45ce-818e-9590d818d7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:06.327584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 204/429] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:06.333419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:06.403873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 226/430] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:06.429351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541c2f6-2e1f-45ce-818e-9590d818d7e0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:06.463991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bbc3-6777-4d77-8a77-c3145bbd33dd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.504947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.506168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.506694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.507898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] PATH_INFO: `/v3/projects/5e4e4bb940334527ae5eccc044f5c39f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.509474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] RBAC: Authorizing `identity:get_project(project_id=5e4e4bb940334527ae5eccc044f5c39f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:06.511145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:06.513435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 205/431] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:06 2022] GET /identity/v3/projects/5e4e4bb940334527ae5eccc044f5c39f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:06.519342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:06.548546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541c2f6-2e1f-45ce-818e-9590d818d7e0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.598415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.600137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.600804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.601320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.616132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:06.627363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:06.628342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:10:06.629125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:06.632446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 227/432] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:06.639731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:06.649513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331559b9-07d9-4f61-afb1-1c1a76067aaf None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.690520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.691326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.691661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.691936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.693431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:06.695324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:06.698160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 206/433] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:06 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:06.705097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:06.769262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b03ac-4307-408d-9bb6-e02ad388c455 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.803858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.804764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.805139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.805518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.806390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:06.806794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:06.808488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:06.818691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 228/434] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:10:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:06.824378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:06.845356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efea342-8fa0-440e-a544-fb3c1d6566c9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.891329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40ec9-bdc6-4d97-9440-29e35aae02d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.892815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40ec9-bdc6-4d97-9440-29e35aae02d6 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.893254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40ec9-bdc6-4d97-9440-29e35aae02d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.893946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40ec9-bdc6-4d97-9440-29e35aae02d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.895099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40ec9-bdc6-4d97-9440-29e35aae02d6 None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=5e4e4bb940334527ae5eccc044f5c39f) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:06.895600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40ec9-bdc6-4d97-9440-29e35aae02d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:06.897983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40ec9-bdc6-4d97-9440-29e35aae02d6 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:06.906185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 207/435] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:10:06 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=5e4e4bb940334527ae5eccc044f5c39f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:06.908278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef33a-cd39-4cfc-9d48-e3d56ae00426 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.909011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef33a-cd39-4cfc-9d48-e3d56ae00426 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.909451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef33a-cd39-4cfc-9d48-e3d56ae00426 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.911947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 208/436] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:06.919055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc47d-6cd1-467d-807d-4248665ae750 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.919371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc47d-6cd1-467d-807d-4248665ae750 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.919661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc47d-6cd1-467d-807d-4248665ae750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:06.934248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4296147-8091-41ce-9494-5e1ac6c06b0d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:06.939569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a77fc47d-6cd1-467d-807d-4248665ae750 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:06.940876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a77fc47d-6cd1-467d-807d-4248665ae750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:06.976429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:06.977457 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:06.978019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:06.978470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.024043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 209/437] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:07.040482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc47d-6cd1-467d-807d-4248665ae750 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.059232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:07.061102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:07.157794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc47d-6cd1-467d-807d-4248665ae750 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.206945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.207728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.208015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.208298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.208662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 229/438] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:07.214642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.224235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:07.233119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:07.234062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:07.235410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 210/439] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:07.240676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.330276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae66e0-c7cd-4172-a7c2-629f1d4d70c2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.373654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965eceb-02ff-43ec-904b-2705cc542f3b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.375899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f8150-2a23-4aef-b152-128318a3b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.376029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8150-2a23-4aef-b152-128318a3b08a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.376270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8150-2a23-4aef-b152-128318a3b08a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.376543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8150-2a23-4aef-b152-128318a3b08a None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.378690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f8150-2a23-4aef-b152-128318a3b08a None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:07.380194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f8150-2a23-4aef-b152-128318a3b08a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:07.381895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 230/440] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:07.383186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d1ff5-be8b-497d-82f8-d2cd545c92bf None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.383488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d1ff5-be8b-497d-82f8-d2cd545c92bf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.383785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d1ff5-be8b-497d-82f8-d2cd545c92bf None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.385154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 231/441] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:07.388978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d1ff5-be8b-497d-82f8-d2cd545c92bf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.414712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0079-7b00-4d8c-be90-0c06fa2ca4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.415400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0079-7b00-4d8c-be90-0c06fa2ca4fb None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.415717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0079-7b00-4d8c-be90-0c06fa2ca4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.416000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0079-7b00-4d8c-be90-0c06fa2ca4fb None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.416758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0079-7b00-4d8c-be90-0c06fa2ca4fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:07.417067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0079-7b00-4d8c-be90-0c06fa2ca4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:07.418446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0079-7b00-4d8c-be90-0c06fa2ca4fb None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:07.427432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 211/442] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:07.428932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eebc9-a90f-45e9-a837-3e659acd6463 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.429368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eebc9-a90f-45e9-a837-3e659acd6463 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.429644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eebc9-a90f-45e9-a837-3e659acd6463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.447600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1e0eebc9-a90f-45e9-a837-3e659acd6463 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:07.448799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1e0eebc9-a90f-45e9-a837-3e659acd6463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:07.507946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d1ff5-be8b-497d-82f8-d2cd545c92bf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.526991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 212/443] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:07.527894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eebc9-a90f-45e9-a837-3e659acd6463 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.553581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.554432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.554723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.554999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.556265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:07.557707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:07.559370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 232/444] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:07.560164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.627267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eebc9-a90f-45e9-a837-3e659acd6463 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.655624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f747f2-42a2-4880-b8c2-f2d3b1f65cfb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.661082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.661736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.662024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.662304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.688691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.689542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.689819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.690085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.700513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:07.708061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:07.709036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:07.709854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 233/445] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:07.710531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.736118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:07.737589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:07.807854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fd25f-99bf-41cb-9a8d-611e4507ae95 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.836415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 213/446] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:07.837271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.839701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.840366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.840645 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.841060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.841898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5520771cec5b4260bae84ce5d70ae39a, scope.project.id=109c2756e5b44414aa74c994e9b4b33f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:07.842208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:07.844230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:07.850193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 234/447] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5520771cec5b4260bae84ce5d70ae39a => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:07.850989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:07.948175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d543-5558-46ea-9c37-b168dedb8384 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.961454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2768f-77fb-40de-b501-bad3f56d82e9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:07.983301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:07.984899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:07.985188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:07.985470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:07.986238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:07.986547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:07.987977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:07.997196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 214/448] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:08.003404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:08.003948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:08.004853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:08.005133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:08.005404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] PATH_INFO: `/v3/projects/109c2756e5b44414aa74c994e9b4b33f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:08.006944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] RBAC: Authorizing `identity:get_project(project_id=109c2756e5b44414aa74c994e9b4b33f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:08.008485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:08.014867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 235/449] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:07 2022] GET /identity/v3/projects/109c2756e5b44414aa74c994e9b4b33f => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:08.016771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:08.113608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46663a-66a4-4d1b-984a-5d15bfdf5c8a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:08.144509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26796-9938-4883-a719-e6e7193b3ffc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:08.152504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:08.153160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:08.153442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:08.153720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:08.186152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:08.187101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:08.187947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:08.189199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] PATH_INFO: `/v3/groups/33ae193e840241949d9c25af0bd3e1c3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:08.189459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] RBAC: Authorizing `identity:get_group(group_id=33ae193e840241949d9c25af0bd3e1c3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:08.190837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:08.192510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 236/450] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:08 2022] GET /identity/v3/groups/33ae193e840241949d9c25af0bd3e1c3 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:08.198235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:08.232766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:08.234788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:08.302496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbd6b1-3e32-4906-a1df-a51d1a890f91 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:08.333480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 215/451] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:10:08.338085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:08.338085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:08.338085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:08.338085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:08.338398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] RBAC: Adding query filter params (group.id=33ae193e840241949d9c25af0bd3e1c3, role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=109c2756e5b44414aa74c994e9b4b33f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:08.338398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:08.338398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:08.338912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:08.350412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 237/452] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:10:08 2022] GET /identity/v3/role_assignments?group.id=33ae193e840241949d9c25af0bd3e1c3&scope.project.id=109c2756e5b44414aa74c994e9b4b33f&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:08.442280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0c7b-c523-41dc-8331-b3af4b6bf86b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:08.478266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:08.479143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:08.479431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:08.479739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] PATH_INFO: `/v3/projects/a3a7cd6436bd466e8794acccf97ede79` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:08.481009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] RBAC: Authorizing `identity:get_project(project_id=a3a7cd6436bd466e8794acccf97ede79)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:08.482476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:08.484876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 216/453] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:10:08 2022] GET /identity/v3/projects/a3a7cd6436bd466e8794acccf97ede79 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:08.490635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:08.590801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a0d6e-afbc-4cc3-91c5-c59963c3bda8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:08.624761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8cef-f4ef-4a02-badb-8ac9fb441bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:08.625624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8cef-f4ef-4a02-badb-8ac9fb441bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:08.625929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8cef-f4ef-4a02-badb-8ac9fb441bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:08.626205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8cef-f4ef-4a02-badb-8ac9fb441bc3 None admin] PATH_INFO: `/v3/groups/3d9f45df1dc44eb08a455a9223cf7b13` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:08.627390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8cef-f4ef-4a02-badb-8ac9fb441bc3 None admin] RBAC: Authorizing `identity:get_group(group_id=3d9f45df1dc44eb08a455a9223cf7b13)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:08.628857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8cef-f4ef-4a02-badb-8ac9fb441bc3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:08.630803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 238/454] 10.222.0.55 () {56 vars in 1180 bytes} [Thu May 5 15:10:08 2022] GET /identity/v3/groups/3d9f45df1dc44eb08a455a9223cf7b13 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:08.636497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:08.740099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb778f-4f36-4bfc-a622-b29ed46a46ba None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:08.774010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5c23-d6f3-4bfc-afa3-50862b99806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:08.774657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5c23-d6f3-4bfc-afa3-50862b99806a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:08.774938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5c23-d6f3-4bfc-afa3-50862b99806a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:08.775210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5c23-d6f3-4bfc-afa3-50862b99806a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:08.776070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5c23-d6f3-4bfc-afa3-50862b99806a None admin] RBAC: Adding query filter params (group.id=3d9f45df1dc44eb08a455a9223cf7b13, role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=a3a7cd6436bd466e8794acccf97ede79) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:08.776379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5c23-d6f3-4bfc-afa3-50862b99806a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:08.777797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5c23-d6f3-4bfc-afa3-50862b99806a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:08.784115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 217/455] 10.222.0.55 () {56 vars in 1376 bytes} [Thu May 5 15:10:08 2022] GET /identity/v3/role_assignments?group.id=3d9f45df1dc44eb08a455a9223cf7b13&scope.project.id=a3a7cd6436bd466e8794acccf97ede79&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:11.584834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88db6-844d-43db-96d7-20b9b0ffee0c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:11.585904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88db6-844d-43db-96d7-20b9b0ffee0c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:11.586404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88db6-844d-43db-96d7-20b9b0ffee0c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:11.588324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 239/456] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:11.594534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76c928-cee4-4ced-820b-114576fc1cc6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:11.595717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76c928-cee4-4ced-820b-114576fc1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:11.596232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76c928-cee4-4ced-820b-114576fc1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:11.620727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ad76c928-cee4-4ced-820b-114576fc1cc6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:11.622323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ad76c928-cee4-4ced-820b-114576fc1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:11.716340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 218/457] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:11.771841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88db6-844d-43db-96d7-20b9b0ffee0c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:11.912254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88db6-844d-43db-96d7-20b9b0ffee0c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:11.961130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:11.962353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:11.962845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:11.963345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:11.979651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:11.981465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:11.994379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35909f-ea9b-4b16-bc69-f53df7447dc8 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:11.994997 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35909f-ea9b-4b16-bc69-f53df7447dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:11.995655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35909f-ea9b-4b16-bc69-f53df7447dc8 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:11.997230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 219/458] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:10:12.003338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756873ce-606d-41cc-bc84-1738b5c63084 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.003935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756873ce-606d-41cc-bc84-1738b5c63084 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.004414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756873ce-606d-41cc-bc84-1738b5c63084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:12.021224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:12.022152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:12.022996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:12.022996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:12.022996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.022996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:12.034321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 240/459] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:12.035643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-756873ce-606d-41cc-bc84-1738b5c63084 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:12.037083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-756873ce-606d-41cc-bc84-1738b5c63084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:12.041749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.130092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 220/460] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:12.132158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a123-91c3-4c45-91e3-91bff583db97 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.132525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a123-91c3-4c45-91e3-91bff583db97 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.132820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a123-91c3-4c45-91e3-91bff583db97 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.134401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 221/461] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:12.140954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26f6a-9942-4b9e-bd8d-4fd042f3ba60 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.141224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26f6a-9942-4b9e-bd8d-4fd042f3ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.141509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26f6a-9942-4b9e-bd8d-4fd042f3ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.164163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f4c26f6a-9942-4b9e-bd8d-4fd042f3ba60 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:12.165283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f4c26f6a-9942-4b9e-bd8d-4fd042f3ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:12.176498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f5b82-e518-423f-a386-7313f9432242 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.219035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea966-b8b4-4ff8-ae35-8fa83316e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.220169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea966-b8b4-4ff8-ae35-8fa83316e48d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.220654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea966-b8b4-4ff8-ae35-8fa83316e48d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.221163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea966-b8b4-4ff8-ae35-8fa83316e48d None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.222480 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ea966-b8b4-4ff8-ae35-8fa83316e48d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:12.223015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ea966-b8b4-4ff8-ae35-8fa83316e48d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.225549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ea966-b8b4-4ff8-ae35-8fa83316e48d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:12.243359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 222/462] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:12.253010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be87d1-d747-4b8a-9bc3-852a08aa96d8 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.253380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be87d1-d747-4b8a-9bc3-852a08aa96d8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.253628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be87d1-d747-4b8a-9bc3-852a08aa96d8 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.255177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 223/463] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:12.266645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be87d1-d747-4b8a-9bc3-852a08aa96d8 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.267242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 241/464] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:12.269761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76965-d59f-4648-99e5-332099a2f709 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.270245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76965-d59f-4648-99e5-332099a2f709 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.270723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76965-d59f-4648-99e5-332099a2f709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.290634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-55e76965-d59f-4648-99e5-332099a2f709 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:12.291874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-55e76965-d59f-4648-99e5-332099a2f709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:12.360416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 242/465] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:12.361599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76965-d59f-4648-99e5-332099a2f709 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.370061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be87d1-d747-4b8a-9bc3-852a08aa96d8 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.404641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.405437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.405728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.406633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.429196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.429196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:12.442027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:12.442919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:12.443809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:12.443809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:12.443809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.443809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:12.443809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 224/466] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:12.444068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.478517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76965-d59f-4648-99e5-332099a2f709 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.513292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.513971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.514260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.514541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.516075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.517530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:12.545992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d46ad8-b3f3-441a-838e-de0db3dc10aa None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.579107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.579936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.580209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.580480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.593019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.595165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:12.612463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:12.613333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:12.614240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:12.614240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:12.614240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.614240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:12.614240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 225/467] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:12.615013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.628544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 243/468] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:10:12 2022] POST /identity/v3/users => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:12.630090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.744690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9f12-207d-4868-aafd-6316bbe98664 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.775437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619f6f4-e368-473c-9282-f4042a4f9685 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.789130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.790624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.791100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.791580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.808090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.810697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:12.815583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.816665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.817177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.817644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.818636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:12.819256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.821038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:12.832031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:12.832934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:12.839863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:12.839863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:12.839863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:12.839863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:12.839863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 226/469] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:12.839863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.840218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 244/470] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:12.840481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:12.949411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cb14a-3130-4acd-bc30-c00a23c9adce None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.957152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af094de0-812a-44c3-bbc4-e7b05178f897 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:12.984911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.985585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.985870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.986155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.986879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:12.987185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.988603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:12.992814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b893-c63b-491f-8daa-0912cb3935f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:12.993670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b893-c63b-491f-8daa-0912cb3935f5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:12.994093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b893-c63b-491f-8daa-0912cb3935f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:12.994506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b893-c63b-491f-8daa-0912cb3935f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:12.995417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b893-c63b-491f-8daa-0912cb3935f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:12.995915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b893-c63b-491f-8daa-0912cb3935f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:12.997425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b893-c63b-491f-8daa-0912cb3935f5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:13.000507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 245/471] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:13.001325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:13.017829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 227/472] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:13.019732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe36e-5af1-4555-b568-d339deef37d3 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:13.020327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe36e-5af1-4555-b568-d339deef37d3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:13.021039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe36e-5af1-4555-b568-d339deef37d3 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:13.022739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 228/473] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:13.024103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffe36e-5af1-4555-b568-d339deef37d3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:13.102533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8acf98-5de9-469b-802a-40b207cf9a76 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:13.128589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffe36e-5af1-4555-b568-d339deef37d3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:13.143030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693c47c-5c81-40ea-a825-d22defa77a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:13.143735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693c47c-5c81-40ea-a825-d22defa77a24 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:13.144016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693c47c-5c81-40ea-a825-d22defa77a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:13.144291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693c47c-5c81-40ea-a825-d22defa77a24 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:13.144996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693c47c-5c81-40ea-a825-d22defa77a24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:13.146447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693c47c-5c81-40ea-a825-d22defa77a24 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:13.165364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:13.166035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:13.166318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:13.173875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:13.173875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:13.173875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:13.259848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 246/474] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:10:13 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:13.261042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73eca-7872-49ea-8bbc-195ffd83eed6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:13.261323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73eca-7872-49ea-8bbc-195ffd83eed6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:13.261742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73eca-7872-49ea-8bbc-195ffd83eed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:13.280021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8ed73eca-7872-49ea-8bbc-195ffd83eed6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:13.281243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8ed73eca-7872-49ea-8bbc-195ffd83eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:13.292219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 229/475] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:10:13 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:13.294183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:13.437806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 247/476] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:13.489328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73eca-7872-49ea-8bbc-195ffd83eed6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:13.509947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591486-5961-4eab-9cd0-7572c8e99784 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:13.559372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:13.560093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:13.560382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:13.560663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:13.561387 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:13.563566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:13.643558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73eca-7872-49ea-8bbc-195ffd83eed6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:13.646358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 230/477] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:10:13 2022] POST /identity/v3/users => generated 248 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:13.686867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320c761-0357-4513-9c33-89311324a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:13.688117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320c761-0357-4513-9c33-89311324a575 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:13.688608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320c761-0357-4513-9c33-89311324a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:13.689115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320c761-0357-4513-9c33-89311324a575 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:13.690159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320c761-0357-4513-9c33-89311324a575 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:13.691997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320c761-0357-4513-9c33-89311324a575 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:13.736425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.sql.core [None req-c320c761-0357-4513-9c33-89311324a575 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:10:13.736425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 15:10:13.736425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [parameters: {'id': '5334a101e36142dbad4b9cb449617d2e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 15:10:13.736425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c320c761-0357-4513-9c33-89311324a575 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() May 05 15:10:13.755766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return ref.to_dict() May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:10:13.756956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application yield resource May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise self.value May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application session.commit() May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:10:13.758370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.flush() May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application compat.raise_( May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:10:13.760385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:10:13.761854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:10:13.764727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [parameters: {'id': '5334a101e36142dbad4b9cb449617d2e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:13.767979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 15:10:13.773512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:13.775972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 248/478] 10.222.0.55 () {60 vars in 1131 bytes} [Thu May 5 15:10:13 2022] POST /identity/v3/roles => generated 144 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:13.776179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:13.931340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8650bfd-8a98-4c93-8ff8-ad0572a0b79b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:13.976241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086584d1-31bd-4e17-a778-9d680983e6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:13.977070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086584d1-31bd-4e17-a778-9d680983e6cd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:13.977355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086584d1-31bd-4e17-a778-9d680983e6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:13.977632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086584d1-31bd-4e17-a778-9d680983e6cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:13.991839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086584d1-31bd-4e17-a778-9d680983e6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-086584d1-31bd-4e17-a778-9d680983e6cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:14.000475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:14.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:10:14.002139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:14.003294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 231/479] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:14.007368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320c761-0357-4513-9c33-89311324a575 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:14.117200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320c761-0357-4513-9c33-89311324a575 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:14.153894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b739b-396a-42d9-919c-091246483b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:14.154620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b739b-396a-42d9-919c-091246483b50 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:14.154908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b739b-396a-42d9-919c-091246483b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:14.155183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b739b-396a-42d9-919c-091246483b50 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:14.156051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b739b-396a-42d9-919c-091246483b50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:14.156355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b739b-396a-42d9-919c-091246483b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:14.157773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b739b-396a-42d9-919c-091246483b50 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:14.166575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 249/480] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:15.118599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960043e4-7bb5-4160-b82f-a182d78bc848 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:15.119114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960043e4-7bb5-4160-b82f-a182d78bc848 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:15.119189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960043e4-7bb5-4160-b82f-a182d78bc848 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:15.120804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 232/481] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:15.126861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578167d-20e4-4c27-9338-3afb1e2d6ab1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:15.127266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578167d-20e4-4c27-9338-3afb1e2d6ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:15.127431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578167d-20e4-4c27-9338-3afb1e2d6ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:15.144968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2578167d-20e4-4c27-9338-3afb1e2d6ab1 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:15.146330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2578167d-20e4-4c27-9338-3afb1e2d6ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:15.237198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 250/482] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:15.276948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960043e4-7bb5-4160-b82f-a182d78bc848 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:15.423188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960043e4-7bb5-4160-b82f-a182d78bc848 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:15.466700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:15.467527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:15.467815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:15.468141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:15.488366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:15.496091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:15.496950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:15.497713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 233/483] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:15.503849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578167d-20e4-4c27-9338-3afb1e2d6ab1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:15.663813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578167d-20e4-4c27-9338-3afb1e2d6ab1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:15.707042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:15.707724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:15.708010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:15.708286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:15.709045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:15.709350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:15.710723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:15.720379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 251/484] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:15.728574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:15.870886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fa734-9949-410c-9dba-6a711dc0671c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:15.918541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71644e45-518a-4a22-b32a-5e86537014e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:15.919362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644e45-518a-4a22-b32a-5e86537014e9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:15.919678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644e45-518a-4a22-b32a-5e86537014e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:15.919959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644e45-518a-4a22-b32a-5e86537014e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:15.938091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71644e45-518a-4a22-b32a-5e86537014e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:15.939591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71644e45-518a-4a22-b32a-5e86537014e9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-71644e45-518a-4a22-b32a-5e86537014e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:15.965537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:15.966427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:15.967255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:15.967255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:15.967255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:15.967255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:15.967255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 234/485] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:15.973014 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.105098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace0f9-ec38-429b-b3bd-6386894032b9 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.105761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace0f9-ec38-429b-b3bd-6386894032b9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.106243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace0f9-ec38-429b-b3bd-6386894032b9 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.106417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f04e-b263-4fb4-8828-88722dd5fe07 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.108323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 235/486] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:16.116958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179392-a423-492a-a865-943c6acd4d01 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.117563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179392-a423-492a-a865-943c6acd4d01 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.118047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179392-a423-492a-a865-943c6acd4d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.143492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648243d-a81f-49eb-bb70-33344bc5d900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.143492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648243d-a81f-49eb-bb70-33344bc5d900 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.143492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648243d-a81f-49eb-bb70-33344bc5d900 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.143492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648243d-a81f-49eb-bb70-33344bc5d900 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.144224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648243d-a81f-49eb-bb70-33344bc5d900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:16.144224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648243d-a81f-49eb-bb70-33344bc5d900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.145506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648243d-a81f-49eb-bb70-33344bc5d900 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.146740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ed179392-a423-492a-a865-943c6acd4d01 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:16.148478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ed179392-a423-492a-a865-943c6acd4d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:16.158572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 252/487] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:16.159950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea9b5-6463-44c6-8225-f29d1678d88d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.160240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea9b5-6463-44c6-8225-f29d1678d88d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.160517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ea9b5-6463-44c6-8225-f29d1678d88d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.162025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 253/488] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:16.167312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85688-e76a-44a4-91ef-570da0b859a4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.167627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85688-e76a-44a4-91ef-570da0b859a4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.167904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85688-e76a-44a4-91ef-570da0b859a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.184940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fbb85688-e76a-44a4-91ef-570da0b859a4 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:16.186114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fbb85688-e76a-44a4-91ef-570da0b859a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:16.226500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 236/489] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:16.227755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed179392-a423-492a-a865-943c6acd4d01 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.260107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 254/490] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:16.273773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85688-e76a-44a4-91ef-570da0b859a4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.330044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed179392-a423-492a-a865-943c6acd4d01 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.365523 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.366568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.367020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.367441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.375745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.377378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.389048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85688-e76a-44a4-91ef-570da0b859a4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:16.393530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:16.394621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:16.395753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:16.402120 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 237/491] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:16.403175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.434816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.435950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.436387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.437406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.453936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:16.463936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:16.465090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:16.466089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:16.468497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 255/492] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:16.469566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.516135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bc6cf-d0f4-4da5-8e16-2ed224d75571 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.554114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.554891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.555177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.555452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.566776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:16.574507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:16.575616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:16.576512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:16.579584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 238/493] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:16.580016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67c0c-7fb5-4fd2-bff1-6b5033b4ad8e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.580426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.617795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.618750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.619182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.619633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.620631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:16.621082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.622736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.661205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 256/494] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:16.662341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.686661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5c62a-5f33-4970-890e-e83e7cec536b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.723648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba8ae6-444b-47d4-923d-5da9644f12df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.723648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba8ae6-444b-47d4-923d-5da9644f12df None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.723648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba8ae6-444b-47d4-923d-5da9644f12df None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.723648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba8ae6-444b-47d4-923d-5da9644f12df None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.724057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba8ae6-444b-47d4-923d-5da9644f12df None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:16.724057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba8ae6-444b-47d4-923d-5da9644f12df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.724057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba8ae6-444b-47d4-923d-5da9644f12df None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.735175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 239/495] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:16.736687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461e59a-caa0-47a8-8dbf-b2680c035db6 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.737098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461e59a-caa0-47a8-8dbf-b2680c035db6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.737322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461e59a-caa0-47a8-8dbf-b2680c035db6 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.741214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 240/496] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:16.744258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461e59a-caa0-47a8-8dbf-b2680c035db6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.777184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1cb59-3939-466a-9955-ec8dd76ea99d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.809183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.809832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.810110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.810381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.811122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:16.811426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.813421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.826729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 257/497] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:16.826729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:16.849731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461e59a-caa0-47a8-8dbf-b2680c035db6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.883460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.884141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.884421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.884854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.924500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de19852-838d-4bfa-98f0-4d3893cc3245 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:16.951555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.953641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.957413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2aa5f-0c44-49c0-8ee0-4ba9a0fa84a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:16.958212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2aa5f-0c44-49c0-8ee0-4ba9a0fa84a5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.958493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2aa5f-0c44-49c0-8ee0-4ba9a0fa84a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.958768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2aa5f-0c44-49c0-8ee0-4ba9a0fa84a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:16.970087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2aa5f-0c44-49c0-8ee0-4ba9a0fa84a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:16.971572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2aa5f-0c44-49c0-8ee0-4ba9a0fa84a5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-90b2aa5f-0c44-49c0-8ee0-4ba9a0fa84a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:16.988246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:16.989211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:16.990056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:16.990056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:16.990056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:16.990056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:16.994045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 258/498] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:16.995187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee542d-aeaf-4a5d-8d56-cebed76992a7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:16.995499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee542d-aeaf-4a5d-8d56-cebed76992a7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:16.995771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee542d-aeaf-4a5d-8d56-cebed76992a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.013051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6dee542d-aeaf-4a5d-8d56-cebed76992a7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:17.014239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6dee542d-aeaf-4a5d-8d56-cebed76992a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:17.055248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 241/499] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:17.056133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.103521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 259/500] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:17.103521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee542d-aeaf-4a5d-8d56-cebed76992a7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.157391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8330-b29d-436b-b3c5-a35b7ce1c4bb None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.189821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.190638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.190920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.191195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.202963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.203495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee542d-aeaf-4a5d-8d56-cebed76992a7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.205143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:17.225084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:17.226112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:17.231999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:17.231999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:17.231999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:17.231999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:17.231999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 242/501] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:17.231999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.247095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.247815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.248102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.248381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.249106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:17.250006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.251389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.268156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 260/502] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:17.268156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.328925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe816b-6b81-473a-9e07-0e0e9d29bc08 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.367320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.367320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.367320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.367320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.371586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1ef5-050a-4f9f-9ba8-e93b455c2fc8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.375839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.377281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:17.396036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:17.397648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:17.400077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:17.400077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:17.400077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:17.400077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:17.401773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 243/503] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:17.402511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.417774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.418585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.418869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.419151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.433150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:17.441756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:17.442768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 261/504] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:17.443929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.502699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2576db9-36c0-4b49-b90c-ff72b6c76e83 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.534144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.534799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.535078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.535350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.536110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:17.536413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.537780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.539074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063999d-fb9f-4f4d-9cf0-03a867eba4c4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.549718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 244/505] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:17.550427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.572666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958becd-4f3d-497b-85a1-42024b82c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.573464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958becd-4f3d-497b-85a1-42024b82c2ac None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.573746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958becd-4f3d-497b-85a1-42024b82c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.574023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958becd-4f3d-497b-85a1-42024b82c2ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.582211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958becd-4f3d-497b-85a1-42024b82c2ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.583626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958becd-4f3d-497b-85a1-42024b82c2ac None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c958becd-4f3d-497b-85a1-42024b82c2ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:17.598505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:17.599530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:17.600472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 262/506] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:17.601124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3333c-8a2d-4540-bd28-86373d9c1c86 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.601199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3333c-8a2d-4540-bd28-86373d9c1c86 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.601592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3333c-8a2d-4540-bd28-86373d9c1c86 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.606622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 263/507] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:17.606622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3333c-8a2d-4540-bd28-86373d9c1c86 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.646203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ce1e5-9a1c-473e-9a8b-1f24b805b2bd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.678736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.679394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.679707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.680033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.680758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:17.681065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.682570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.694119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 245/508] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:17.694920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.702106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3333c-8a2d-4540-bd28-86373d9c1c86 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.733320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0296c6-e752-491b-bce2-6e541badef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.734502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0296c6-e752-491b-bce2-6e541badef95 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.734780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0296c6-e752-491b-bce2-6e541badef95 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.735044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0296c6-e752-491b-bce2-6e541badef95 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.735827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0296c6-e752-491b-bce2-6e541badef95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:17.736133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0296c6-e752-491b-bce2-6e541badef95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.737518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0296c6-e752-491b-bce2-6e541badef95 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.745643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 264/509] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:17.747090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfd50-b09a-4e1e-a322-083e2072f2fe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.747556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfd50-b09a-4e1e-a322-083e2072f2fe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.747840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfd50-b09a-4e1e-a322-083e2072f2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.766583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a49cfd50-b09a-4e1e-a322-083e2072f2fe None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:17.768095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a49cfd50-b09a-4e1e-a322-083e2072f2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:17.800863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638bf73-c117-4de6-ad52-a145a595e20f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.836003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.836712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.836994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.837270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.839282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 265/510] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:17.851658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cfd50-b09a-4e1e-a322-083e2072f2fe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.851772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.851772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:17.860468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:17.861378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:17.862277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 246/511] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:17.862851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.938575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cfd50-b09a-4e1e-a322-083e2072f2fe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.961373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843decab-38ea-421e-8988-fdf01389b60a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:17.973099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.973787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.974069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.974345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:17.975200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:17.975534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:17.977026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:17.994851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 266/512] 10.222.0.55 () {56 vars in 1139 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:17.995909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:17.996105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:17.996946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:17.997230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:17.997506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.005246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.006728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:18.022938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:18.023945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:18.024778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 247/513] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:18.025267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.106274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d208-05aa-48b4-9382-1f0d2bdbbf13 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.123049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09091c9e-c391-4ebe-a94a-61b6d51e6d84 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.147450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.148281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.148560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.148844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.159627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.160189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.160423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.160702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.160970 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.161541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.171087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.173010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:18.179192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:18.180156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:18.181020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:18.181020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:18.181020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:18.181020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:18.181020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 267/514] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:18.181287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:18.190383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:18.191311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:18.192198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:18.192198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:18.192198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:18.192198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:18.192198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 248/515] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:18.192505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.278339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98332219-dffe-4409-89e2-fb59a247c2b1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.289232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c2caa-0bcd-4927-94ba-a476deb5e50c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.311075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.311814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.312095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.312371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.313190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:18.313497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.315052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.321322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.321970 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.322254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.322530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.331596 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 268/516] 10.222.0.55 () {56 vars in 1137 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:18.332416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.386567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.388118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.425644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16d8d9-1d2d-465a-81dc-db795ebd1eaf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.458456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.459122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.459409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.459717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.460499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:18.460810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.462252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.480718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 269/517] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:18.481538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.494017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 249/518] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:18.494017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.578518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe03de6-d7d1-4804-833b-b3e02e7fa5ff None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.584945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b29ca7-a5a0-45e7-82a3-4344a5a2696b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.611015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.611799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.612147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.612492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.618315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:18.618315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.618315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.618597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.618597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.618597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.618943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.619625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:18.619938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.621302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.626476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 270/519] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:18.627286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.636928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 250/520] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:18.636928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.722895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c924de7-1998-489d-8e9c-f0afe4069745 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.728741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5a4d-5ff9-4932-b89d-6f56936d92bc None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.758359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.759016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.759294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.759591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.767503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.768192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.768472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.768743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.769615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=abbda90b98bd49569e59c973edba73b4) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:18.770103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.771722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.779419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 251/521] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/role_assignments?user.id=abbda90b98bd49569e59c973edba73b4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:18.780290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.836584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.838096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.897580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eb2b7-b7a6-4f6b-9d23-496f9a408572 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:18.939534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:18.940510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:18.941150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:18.941435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:18.947379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 271/522] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:18.948582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:18.957570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:18.959059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:18.977289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:18.978226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:18.979065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:18.979065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:18.979065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:18.979065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:18.979065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 252/523] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:18.979835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.058347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bf1aa-1ba5-40ac-ba4c-54c5c9e4fa2e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.088170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c4d40-dfcc-4176-b505-11bba02f22b0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.107934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.109311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.109589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.109862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.117699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.119171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.137580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.138257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.138543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.138822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.139553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:19.140359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:19.141194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:10:19.142092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:19.142587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.142681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 272/524] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:19.143727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.231608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 253/525] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:10:18 2022] POST /identity/v3/users => generated 247 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:19.231608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.251142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdddfe-0870-47b0-8b15-5f4cde04f175 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.290940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.291838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.292125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.292402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.304755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.306279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:19.325799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:19.326712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:19.327581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:19.327581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:19.327581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:19.327581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:19.327581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 273/526] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:19.328890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.341641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e50aa-273d-46da-a3d8-039a3f0d1283 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.378374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065272c3-9119-4263-b67d-005157c9201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.379053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065272c3-9119-4263-b67d-005157c9201e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.379332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065272c3-9119-4263-b67d-005157c9201e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.379661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065272c3-9119-4263-b67d-005157c9201e None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.380395 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065272c3-9119-4263-b67d-005157c9201e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:19.380702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065272c3-9119-4263-b67d-005157c9201e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.382123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065272c3-9119-4263-b67d-005157c9201e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.395920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 254/527] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:19.396784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065272c3-9119-4263-b67d-005157c9201e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.442898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebaa6e-740b-4b66-8c2d-f8fabcd28a71 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.486074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.486681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.486967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.487242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.488125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:19.488436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.489889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.509619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 274/528] 10.222.0.55 () {56 vars in 1137 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:19.514643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.528543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065272c3-9119-4263-b67d-005157c9201e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.575430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.576137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.576431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.576710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.578005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:19.578309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.580212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.593368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 255/529] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:19.593733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.628129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057a01-e51a-4afd-8b3e-4eb72485d22a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.662586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.663800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.664352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.664825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.672896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.674719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:19.690207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:19.691246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:19.692115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:19.698889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bf9e-1fff-4a76-b99b-8013143a30b1 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.699218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 275/530] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:19.701953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.730497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.731162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.731449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.731758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.801859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.803324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.810057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106d95b-a871-4861-a87f-8a7c40a07206 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:19.844045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:19.845191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:19.845677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:19.846171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:19.853512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:19.855240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:19.870220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:19.871179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:19.872040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:19.875029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 276/531] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:19.876134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.904756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 256/532] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:19.906027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:19.978749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048674c-c408-488c-afa1-b0602a2a95b7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.007587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc01f-9b43-4ee4-8c07-c0f7f6e1bcd4 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.015817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.016888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.017393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.017881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.018878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:20.019407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.021114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.033506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 277/533] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:20.034629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:20.043942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.044610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.044897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.045176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.046043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:20.046304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.047812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.066901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 257/534] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:20.067867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:20.137660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe23f2-40dc-44d9-80b9-f6631ad375ea None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.169962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4613-a1b8-4784-9dfb-2e8d42bab79c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.172261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.173387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.173883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.174354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.185838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.188163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.205482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.206139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.206426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.206703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:20.207461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:20.208286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:20.209115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:20.209115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:20.209115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:20.209115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:20.209334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=9c25e83af7604455bad1d7c0ee1c0122) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:20.209334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.209334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.211177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 278/535] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:20.212206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:20.215445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 258/536] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:20 2022] GET /identity/v3/role_assignments?user.id=9c25e83af7604455bad1d7c0ee1c0122&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:20.216798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:20.317162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1bb8a-4c22-4e12-97d9-75376a145d59 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.321969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab2a35-ba31-454b-a227-6a8bf16a23f9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.354353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.355490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.356017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.356561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.357663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=fd89045deca342e5a4a6fa39c5bde4c4) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:20.358174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.358345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.359792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.360150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.360508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.361185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.361335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:20.361759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.363244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.368574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 279/537] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:20 2022] GET /identity/v3/role_assignments?user.id=fd89045deca342e5a4a6fa39c5bde4c4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:20.380135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 259/538] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:20.388873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:20.551660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0348-7140-4461-849e-6fbdd3d01fa2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.599099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.599925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.600207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.600483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.608051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.610123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:20.626639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:20.627569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:20.628426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 280/539] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:20.633625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:20.755203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d53c7-5ea3-4e2e-9299-b7eb95433540 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.788938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07b789-96d5-43c2-be22-0fcdefdf704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.789601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b789-96d5-43c2-be22-0fcdefdf704e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.789883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b789-96d5-43c2-be22-0fcdefdf704e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.790157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b789-96d5-43c2-be22-0fcdefdf704e None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.790939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07b789-96d5-43c2-be22-0fcdefdf704e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:20.791244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07b789-96d5-43c2-be22-0fcdefdf704e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.792731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07b789-96d5-43c2-be22-0fcdefdf704e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.805538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 260/540] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:20.811243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:20.937239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7bd24-1bdb-439c-b666-5ac16f96887a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:20.974349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0259c03-df55-4f1d-870d-10c86088cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:20.975010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259c03-df55-4f1d-870d-10c86088cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:20.975289 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259c03-df55-4f1d-870d-10c86088cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:20.975593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259c03-df55-4f1d-870d-10c86088cfa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:20.976416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0259c03-df55-4f1d-870d-10c86088cfa9 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=fc69b41ea4d6456f9532cee386265e61) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:20.976724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0259c03-df55-4f1d-870d-10c86088cfa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:20.978171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0259c03-df55-4f1d-870d-10c86088cfa9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:20.984665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 281/541] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:20 2022] GET /identity/v3/role_assignments?user.id=fc69b41ea4d6456f9532cee386265e61&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:21.415540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d76c-a727-4590-bbf6-f8c7fdf653d2 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:21.416055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d76c-a727-4590-bbf6-f8c7fdf653d2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:21.416131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d76c-a727-4590-bbf6-f8c7fdf653d2 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:21.417722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 261/542] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:21.423324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d285e-9ac7-401d-9714-c1e14be76981 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:21.423773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d285e-9ac7-401d-9714-c1e14be76981 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:21.423950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d285e-9ac7-401d-9714-c1e14be76981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:21.443991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-169d285e-9ac7-401d-9714-c1e14be76981 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:21.445270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-169d285e-9ac7-401d-9714-c1e14be76981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:21.533708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 282/543] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:21.567028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d76c-a727-4590-bbf6-f8c7fdf653d2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:21.793453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d76c-a727-4590-bbf6-f8c7fdf653d2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:21.841570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866bafd-550c-468e-865e-976972bc6109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:21.842373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866bafd-550c-468e-865e-976972bc6109 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:21.842655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866bafd-550c-468e-865e-976972bc6109 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:21.842972 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866bafd-550c-468e-865e-976972bc6109 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:21.856365 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866bafd-550c-468e-865e-976972bc6109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-a866bafd-550c-468e-865e-976972bc6109 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:21.864879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:21.865818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:21.866619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 262/544] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:21.872380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d285e-9ac7-401d-9714-c1e14be76981 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:21.995686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d285e-9ac7-401d-9714-c1e14be76981 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:21.998977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f3c5-c3ad-4274-a1c9-27a5b18cc504 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:21.999267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f3c5-c3ad-4274-a1c9-27a5b18cc504 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.000198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f3c5-c3ad-4274-a1c9-27a5b18cc504 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.005714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 263/545] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:22.006235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c2ed-7c77-4f47-9f5c-4cba713c72d3 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:22.006519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c2ed-7c77-4f47-9f5c-4cba713c72d3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.006791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c2ed-7c77-4f47-9f5c-4cba713c72d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.037485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-5800c2ed-7c77-4f47-9f5c-4cba713c72d3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:22.038697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5800c2ed-7c77-4f47-9f5c-4cba713c72d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:22.055842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:22.056519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:22.056795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.057061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.057808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:22.058111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:22.059515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:22.073543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 283/546] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:22.080553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:22.159044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 264/547] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:22.211538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fbdc0-eb8c-4eda-808d-b67cb39f8faf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:22.215932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800c2ed-7c77-4f47-9f5c-4cba713c72d3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:22.262290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:22.263008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:22.263279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.263587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.284049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:22.285497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:22.314724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:22.315681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:22.316515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:22.316515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:22.316515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:22.316515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:22.318356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 284/548] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:22.324174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:22.368138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800c2ed-7c77-4f47-9f5c-4cba713c72d3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:22.418362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:22.419163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:22.419434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.419730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.441112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:22.459485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:22.460457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:22.461239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 265/549] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:22.483243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:22.518113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5209-18f5-4f07-9490-d9b1a8450abd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:22.560805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:22.562123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:22.562403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.562672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.563396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:22.563722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:22.565107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:22.588859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 285/550] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:22.594778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:22.691805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffbe47-ab96-4714-ae51-024c94761d35 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:22.770712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:22.771356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:22.771658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.771937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.772760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:22.773065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:22.774465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:22.795378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 266/551] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:22.810943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890195-b592-4494-9278-0af8a3b8ef07 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:22.817094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:22.890861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:22.894272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:22.894272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:22.894272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:22.910145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:22.911216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:22.928694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:22.929635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:22.930537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 286/552] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:10:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:22.936037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.040435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07819e-a819-4fb8-a329-4154ef34cc14 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.046400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b610cf-63fa-43b3-8349-6b0ddcdb1144 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.094472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.096622 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.097433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.098407 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.099240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.100710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.101369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.103228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.104331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:23.105595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:23.108489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:23.130856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:23.132686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:23.146994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 287/553] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:10:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:23.153281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:23.167532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:23.168427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:23.169289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:23.169289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:23.169289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:23.169289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:23.169289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 267/554] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:23.176781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.283634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103e90-94bb-48f0-8be3-23722ffd3751 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.317721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a478e0-d32b-4b68-9ecf-913cbc948a39 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.336759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a3534-ec41-4c2c-8806-33e9ad876ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.341337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a3534-ec41-4c2c-8806-33e9ad876ddf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.341337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a3534-ec41-4c2c-8806-33e9ad876ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.341337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a3534-ec41-4c2c-8806-33e9ad876ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.351314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a3534-ec41-4c2c-8806-33e9ad876ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:23.352525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a3534-ec41-4c2c-8806-33e9ad876ddf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:23.362520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf38ecb-d544-445f-9230-590ba68537c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.366669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38ecb-d544-445f-9230-590ba68537c7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.366669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38ecb-d544-445f-9230-590ba68537c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.366669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38ecb-d544-445f-9230-590ba68537c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.366669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf38ecb-d544-445f-9230-590ba68537c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:23.366669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf38ecb-d544-445f-9230-590ba68537c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:23.366669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf38ecb-d544-445f-9230-590ba68537c7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d70a3534-ec41-4c2c-8806-33e9ad876ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:23.371423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:23.372288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 288/555] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80986b0-efb0-46e9-91f3-9ee1ff73f63e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80986b0-efb0-46e9-91f3-9ee1ff73f63e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80986b0-efb0-46e9-91f3-9ee1ff73f63e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.379903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 289/556] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:23.380430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5dadb-c982-4f52-8df7-a94cf1a15b69 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.380430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5dadb-c982-4f52-8df7-a94cf1a15b69 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.380430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5dadb-c982-4f52-8df7-a94cf1a15b69 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.383908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 290/557] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:23.385212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5dadb-c982-4f52-8df7-a94cf1a15b69 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.389054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 268/558] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:23.390916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94fbdd-e8de-4ab6-b9f2-58a56141274b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.391202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94fbdd-e8de-4ab6-b9f2-58a56141274b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.391491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94fbdd-e8de-4ab6-b9f2-58a56141274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.413129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-2d94fbdd-e8de-4ab6-b9f2-58a56141274b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:23.414322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2d94fbdd-e8de-4ab6-b9f2-58a56141274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:23.503225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 269/559] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:23.505038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5dadb-c982-4f52-8df7-a94cf1a15b69 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.508848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc59e-9679-445d-a61d-f8dac5c1f988 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.509993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc59e-9679-445d-a61d-f8dac5c1f988 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.510510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc59e-9679-445d-a61d-f8dac5c1f988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.535300 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-390dc59e-9679-445d-a61d-f8dac5c1f988 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:23.538339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-390dc59e-9679-445d-a61d-f8dac5c1f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:23.552373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.553048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.553333 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.553608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.554357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:23.554704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:23.557901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:23.572256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 291/560] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:23.573030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.640138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 270/561] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:23.640138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dc59e-9679-445d-a61d-f8dac5c1f988 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.696474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08141fdf-6ff5-4278-93af-fea3402b5e6b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.729161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.729952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.730232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.730504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.734113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dc59e-9679-445d-a61d-f8dac5c1f988 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.738132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:23.739612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:23.754364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:23.755307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:23.756760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 292/562] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:23.757324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.771847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c9213-fe0e-452f-b982-2833a49fa04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.772653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c9213-fe0e-452f-b982-2833a49fa04d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.772939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c9213-fe0e-452f-b982-2833a49fa04d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.773214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c9213-fe0e-452f-b982-2833a49fa04d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.783231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c9213-fe0e-452f-b982-2833a49fa04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-da1c9213-fe0e-452f-b982-2833a49fa04d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:23.790815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:23.791890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:23.792696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 271/563] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:23.793361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83707c1-a234-4501-a8c4-69239031a6b7 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.793801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83707c1-a234-4501-a8c4-69239031a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.793801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83707c1-a234-4501-a8c4-69239031a6b7 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.795341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 272/564] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:23.796670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83707c1-a234-4501-a8c4-69239031a6b7 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.853447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852ad92-7ec8-4c05-93fb-f7dc50380691 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.885255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.886040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.886323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.886601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.893245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83707c1-a234-4501-a8c4-69239031a6b7 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:23.893887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:23.895446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:23.909971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:23.910949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:23.911838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 293/565] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:23.912304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:23.929341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:23.930138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:23.930428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:23.930707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:23.941226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:23.948837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:23.949910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:23.950746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 273/566] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:23.951441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.013769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2187c26-dafd-470c-b361-1e689dda929d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.046613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e708b6d-0ead-489a-9314-b22840b8716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.046828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861ab3-8f85-4909-b227-5d72ecdc0c02 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.047276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e708b6d-0ead-489a-9314-b22840b8716f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.047587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e708b6d-0ead-489a-9314-b22840b8716f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.047862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e708b6d-0ead-489a-9314-b22840b8716f None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.048683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e708b6d-0ead-489a-9314-b22840b8716f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:24.048990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e708b6d-0ead-489a-9314-b22840b8716f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.050423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e708b6d-0ead-489a-9314-b22840b8716f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.067537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 294/567] 10.222.0.55 () {56 vars in 1135 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:24.068872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627dd75-d49b-497a-a223-efb2ca87edf5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.069161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627dd75-d49b-497a-a223-efb2ca87edf5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.069437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627dd75-d49b-497a-a223-efb2ca87edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.079238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.079931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.080214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.080490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.081228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:24.081533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.082916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.085833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1627dd75-d49b-497a-a223-efb2ca87edf5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:24.087018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1627dd75-d49b-497a-a223-efb2ca87edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:24.091091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 274/568] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:24.091819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.152356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 295/569] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:24.153414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627dd75-d49b-497a-a223-efb2ca87edf5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.186616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea2932-aa48-44d3-84f7-541fdc2e6e6a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.219797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.220455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.220739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.221015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.221803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:24.222113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.223546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.235247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 275/570] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:24.236110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.256866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627dd75-d49b-497a-a223-efb2ca87edf5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.289147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.289810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.290090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.290360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.291092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:24.291394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.292771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.300428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 296/571] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:24.301211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.330418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690e49d-2aba-4802-a191-b0712655cc9d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.363235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.363946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.364212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.364503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.394858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba924d7c-d2f8-41e4-a75b-84f7f10844e1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.427954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.428669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.428954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.429233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.433639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.435097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.440170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.441587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:24.457845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:24.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:24.465106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:24.465106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:24.465106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:24.465106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:24.465106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 297/572] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:24.465106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.531800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 276/573] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:24.532624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.559813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7158bfe-2db4-4729-8ee1-a65a6127dbc1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.591794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.592598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.592877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.593149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.602665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:24.610163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:24.611240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 298/574] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:24.617267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.626518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547f7b8-ad2a-4441-be3a-1594b91f6ba0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.659225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.660162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.660447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.660725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/abbda90b98bd49569e59c973edba73b4/roles/572a3d7ebad94e73ac07b1b30d647dfa` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.674606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=abbda90b98bd49569e59c973edba73b4, role_id=572a3d7ebad94e73ac07b1b30d647dfa)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.676109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.733075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61254a-cc67-43b7-afbe-7df1a0e52ec9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.746244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 277/575] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:24 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/abbda90b98bd49569e59c973edba73b4/roles/572a3d7ebad94e73ac07b1b30d647dfa => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:24.747080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.777251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.778075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.778544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.783534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.790424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.791956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:24.809576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:24.810681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:24.812343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:24.812343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:24.812343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:24.812343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:24.814016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 299/576] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:24.815088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.862547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc665541-cdda-4721-a859-b57509d9c65a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.900927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.901619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.901907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.902184 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.902922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:24.903229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.904672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:24.917838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 278/577] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:24.918713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:24.938069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb9974-d03b-4a3c-bca5-2d1d83cb1cd7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:24.972731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:24.973636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:24.973988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:24.974335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:24.985196 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:24.986570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:25.003186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:25.004149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:25.005021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:25.005021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:25.005021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:25.005021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:25.005021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 300/578] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:25.005314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.028072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da41124-8cf7-4a7f-8f5c-42e9220bb6bd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.063057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.064140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.064649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.065075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.065966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:25.066449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.067849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.080704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 279/579] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:25.080704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.103192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3834a8-3a4a-4a08-8012-191ce4fd8a1c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.137736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.138409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.138695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.138972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.140014 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:25.140328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.141691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.153262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 301/580] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:25.154078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.195917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58f577-8b54-46ec-81e3-dd24c74becad None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.230557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.231531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.231823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.232122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.240206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.241581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.253003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b1f2-8442-42c1-b8ac-530c3422a7de None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:25.256044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:25.256948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:10:25.257876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:25.262020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 280/581] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:25.262753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.287175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.287875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.288154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.288424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.289125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:25.289424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.290781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.306791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 302/582] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:25.306791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.380509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad65da-8d1b-4c01-b938-d9b0b3fca00b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.398377 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5664aa-ae34-4542-a516-1f9f64e30cd8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.414258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.415065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.415350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.415654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.426791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.428360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.431978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.433011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.433495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.433967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.442277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.444145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:25.445466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:25.446384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:25.447281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:25.447281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:25.447281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:25.447281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:25.447281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 281/583] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:25.447593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:25.462954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:25.464310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:10:25.465263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:25.468153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 303/584] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:25.469199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.554056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62450-3c3a-45a2-9841-15c1b3186ab7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.582400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7e07c-327e-4ba2-a0d3-6ba621cc0279 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.589604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.590557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.591062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.591408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.592291 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:25.592606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.594057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.615432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.616260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.616537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.616808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.623799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.625852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.637531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 282/585] 10.222.0.55 () {56 vars in 1137 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:25.637531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:25.640725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:25.641619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:25.642594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:25.646511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 304/586] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:25.647385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.735334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71281590-833f-4e8b-8e0a-2d4b9a625956 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.750470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8525a7-ccc1-4ded-95d3-a4804661ef58 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.775489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.776172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.776457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.776733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.777453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:25.777759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.779121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.784643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.785324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.785611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.785888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.786779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:25.787097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.788587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.795078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 283/587] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:25.795078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.816007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 305/588] 10.222.0.55 () {56 vars in 1139 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:25.816007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.900939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46e978-fa6b-407f-bc0d-8c883ed5ee0b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.912285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90933444-13df-4e0b-9ab9-fef5cfca6a97 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:25.934144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.934939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.935223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.935528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.944606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:25.945268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:25.945552 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:25.945829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:25.945936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.946612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:25.946920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:25.947271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.948357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:25.960370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 306/589] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:25.964703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:25.965575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:25.971811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:25.971811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:25.971811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:25.971811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:25.972055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:25.972145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 284/590] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:25.972145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.067514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dafe48-de6b-408c-a57f-fbfa161254cd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.071437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae12d-6bde-45a5-92ad-49c1a17eff3c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.100268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.101134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.101417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.101683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.104519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.105306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.105590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.105864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.109195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.110635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.116424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.117874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:26.124972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:26.125953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 307/591] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:26.131728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:26.137225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:26.138060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:26.138954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:26.138954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:26.138954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:26.138954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:26.138954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 285/592] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:26.139222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.230941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d59c-f041-439f-b648-7b215802a337 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.236085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a9a6-b2ee-4dd5-815b-5228fae7cd49 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.268028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.268394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.268694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.268977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.269079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.269256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.269354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.269521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.270082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=21b75b16948240e0b3539152a63429d9) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:26.270259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:26.270414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.270560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.271836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.271948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.286455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 308/593] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/role_assignments?user.id=21b75b16948240e0b3539152a63429d9&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:26.286455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.286738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 286/594] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:26.286738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.406001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927124c-e78a-400a-99c5-fcbbe58266be None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.419014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef723834-ec45-4bab-8324-f14b78e0507b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.442568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.443249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.443576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.443853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.444701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:26.445008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.446474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.461240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.461919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.462205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.462483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.463213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:26.463567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.464963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.466652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 309/595] 10.222.0.55 () {56 vars in 1137 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:26.466652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.484325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 287/596] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:26.485191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.571513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3db30-f39a-40ac-ac19-09cce1c4ea21 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.587128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54301f8b-f3bb-4697-925d-26a388555033 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.605709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.606550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.606875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.607154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.614597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.616072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.621119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.621921 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.622204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.622483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:26.630504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:26.632571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 310/597] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:26.634776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.639727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.641871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:26.659806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:26.661853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:26.663999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:26.663999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:26.663999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:26.663999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:26.671619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 288/598] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:26.671619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.734739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaac288-536d-4143-a8f6-3db839da733f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.775637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe9ff6-f23c-4a10-87a5-449de7927a6a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.777835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.779010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.779010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.779347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.786842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.788395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:26.803458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:26.804593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:26.805702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:26.811074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 311/599] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:26.812138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.815438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.816305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.816760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.817185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.818121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:26.818629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.820227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.838223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 289/600] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:26.839506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.919456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cc1a-ed90-47c4-87e7-62a261516838 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.944330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ef6f-bd54-451c-8e7c-a984edff8d0f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:26.955586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.956342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.956690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.957035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.957826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:26.958200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.959664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:26.975584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 312/601] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:26.975584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:26.987174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:26.987876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:26.988162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:26.988442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:26.989245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:26.989540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:26.990962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:27.007865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 290/602] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:27.008795 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:27.080085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa7e8b-eea1-47fb-ac93-e8f33a761a7b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:27.110628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f187-14db-494c-a44b-c6c6357ccfaf None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:27.113200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f1348-7616-4b68-9893-125c4cc27f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:27.114171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f1348-7616-4b68-9893-125c4cc27f20 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.115598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f1348-7616-4b68-9893-125c4cc27f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.115598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f1348-7616-4b68-9893-125c4cc27f20 None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/fd89045deca342e5a4a6fa39c5bde4c4/roles/572a3d7ebad94e73ac07b1b30d647dfa` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.133572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f1348-7616-4b68-9893-125c4cc27f20 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=fd89045deca342e5a4a6fa39c5bde4c4, role_id=572a3d7ebad94e73ac07b1b30d647dfa)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:27.135244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f1348-7616-4b68-9893-125c4cc27f20 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:27.144510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:27.145311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.151008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.151008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.152679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:27.154131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:27.168293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:27.169163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:27.170107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 291/603] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:27.171171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:27.219499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 313/604] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:26 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/fd89045deca342e5a4a6fa39c5bde4c4/roles/572a3d7ebad94e73ac07b1b30d647dfa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:27.219499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892891-f147-44b6-9b39-8c5f2f7d2843 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.219499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892891-f147-44b6-9b39-8c5f2f7d2843 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.219499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892891-f147-44b6-9b39-8c5f2f7d2843 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.219499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 314/605] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:27.219499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb892891-f147-44b6-9b39-8c5f2f7d2843 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:27.307072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e2c3-481b-471d-b1b6-fd39d62bb7ce None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:27.345216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:27.346287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.346637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.346804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb892891-f147-44b6-9b39-8c5f2f7d2843 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:27.347061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/9c25e83af7604455bad1d7c0ee1c0122/roles/572a3d7ebad94e73ac07b1b30d647dfa` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.366557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=9c25e83af7604455bad1d7c0ee1c0122, role_id=572a3d7ebad94e73ac07b1b30d647dfa)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:27.368306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:27.394204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0bcc6-4c6f-416b-9074-2d3dd9812c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:27.394880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bcc6-4c6f-416b-9074-2d3dd9812c58 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.395161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bcc6-4c6f-416b-9074-2d3dd9812c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.395438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bcc6-4c6f-416b-9074-2d3dd9812c58 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.396266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0bcc6-4c6f-416b-9074-2d3dd9812c58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:27.396662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0bcc6-4c6f-416b-9074-2d3dd9812c58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:27.398126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0bcc6-4c6f-416b-9074-2d3dd9812c58 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:27.412806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 315/606] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:27.414212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22be7-d790-4c27-94fc-286a6c6c2bd9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.414515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22be7-d790-4c27-94fc-286a6c6c2bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.414799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22be7-d790-4c27-94fc-286a6c6c2bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.435044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-14e22be7-d790-4c27-94fc-286a6c6c2bd9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:27.436830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-14e22be7-d790-4c27-94fc-286a6c6c2bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:27.475453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 292/607] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:27 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/9c25e83af7604455bad1d7c0ee1c0122/roles/572a3d7ebad94e73ac07b1b30d647dfa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:27.479673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:27.514847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 316/608] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:27.538758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22be7-d790-4c27-94fc-286a6c6c2bd9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:27.643343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22be7-d790-4c27-94fc-286a6c6c2bd9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:27.679496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7fc8f-3438-4fdc-87e2-eff07713b5d6 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:27.681132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:27.681949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.682231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.689551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.694216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:27.702153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:27.703181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:27.704500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 317/609] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:27.711808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:27.760755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:27.761666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.761948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.762224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/fc69b41ea4d6456f9532cee386265e61/roles/572a3d7ebad94e73ac07b1b30d647dfa` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.786170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=fc69b41ea4d6456f9532cee386265e61, role_id=572a3d7ebad94e73ac07b1b30d647dfa)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:27.787656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:27.830302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584639b-539d-4566-b522-efb8f304e955 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:27.867785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:27.868458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:27.868793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:27.869074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:27.869818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:27.870174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:27.871697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:27.880984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 318/610] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:27.887626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:27.893949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 293/611] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:27 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/fc69b41ea4d6456f9532cee386265e61/roles/572a3d7ebad94e73ac07b1b30d647dfa => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:28.000239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e30de-c1cd-4ed8-a6dc-1d3bec8d5693 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:28.042097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:28.042920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:28.043203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:28.043502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:28.060241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:28.062432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:28.085341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:28.086479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:28.087431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:28.087431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:28.087431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:28.087431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:28.087431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 319/612] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:28.092484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:28.230565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d83d-f906-4720-b52b-716f8163cfec None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:28.272308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:28.272911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:28.273197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:28.273476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:28.274205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:28.274511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:28.275905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:28.290724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 294/613] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:28.296533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:28.404792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb75b6-594b-4372-a844-a3f763d2d493 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:28.443002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:28.443838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:28.444123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:28.444396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:28.452689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:28.454141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:28.468972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:28.470029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:28.471074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 320/614] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:10:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:28.476036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:28.624582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26406b9-7e15-4718-9f1f-6c8b8bc31a7f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:28.657707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ad43-92de-44e3-84da-ba81dd7b98b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:28.658375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ad43-92de-44e3-84da-ba81dd7b98b2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:28.658655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ad43-92de-44e3-84da-ba81dd7b98b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:28.658930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ad43-92de-44e3-84da-ba81dd7b98b2 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:28.659793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ad43-92de-44e3-84da-ba81dd7b98b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:28.660098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ad43-92de-44e3-84da-ba81dd7b98b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:28.661516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ad43-92de-44e3-84da-ba81dd7b98b2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:28.679584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 295/615] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:10:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:28.685043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:28.758155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b017-8340-4849-8572-9c30419ee11c None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:28.758447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b017-8340-4849-8572-9c30419ee11c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:28.758727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b017-8340-4849-8572-9c30419ee11c None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:28.760402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 296/616] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:10:28.769252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e01e6-e861-4242-aa6e-2cd9183d47d4 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:28.769521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e01e6-e861-4242-aa6e-2cd9183d47d4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:28.770101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e01e6-e861-4242-aa6e-2cd9183d47d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:28.788391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f24e01e6-e861-4242-aa6e-2cd9183d47d4 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:28.790079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f24e01e6-e861-4242-aa6e-2cd9183d47d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:28.865236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 297/617] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:28.875181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427be32-18fa-4943-ad98-e212920a4819 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:28.890293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e01e6-e861-4242-aa6e-2cd9183d47d4 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:28.953769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:28.954809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:28.955295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:28.955809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.003552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e01e6-e861-4242-aa6e-2cd9183d47d4 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:29.043510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:29.044317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.044603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.044884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.057297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:29.068000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:29.068960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:29.069833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 298/618] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:29.075892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:29.087799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:29.089630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:29.192260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347da5-99b4-4012-a8a3-a2113694a251 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:29.230183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:29.230866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.231159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.231496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.232662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:29.233776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:29.235134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:29.245086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 299/619] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:29.251122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:29.328846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 321/620] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:29.333968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:29.363378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e795e2-ce41-4bcd-be6b-9c773d3d1063 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:29.403095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:29.407942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.408522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.409003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.437680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:29.439506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:29.471500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:29.472435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:29.473337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:29.473337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:29.473337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:29.473337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:29.473337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 300/621] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:29.478322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:29.507694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b6f8-1c95-463d-ab25-157dcda68446 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:29.545947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:29.547104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.548321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.548825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.570136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:29.571980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:29.602641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:29.603623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:29.604504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:29.604504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:29.604504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:29.604504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:29.608811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 322/622] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:29.616381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:29.655523 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24c65-9610-41c8-81d2-38e85a7fc8bf None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:29.694006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:29.695188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.695188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.708098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.708098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:29.708098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:29.708098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:29.711338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 301/623] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:29.716962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:29.819198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd606-06ed-4c45-b533-24048e321293 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:29.832006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c4839-3017-4e61-aefa-46ea1fbba192 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:29.864485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b302b-c961-4a33-ad4a-cce76adb05eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:29.865272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b302b-c961-4a33-ad4a-cce76adb05eb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.865551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b302b-c961-4a33-ad4a-cce76adb05eb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.865875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b302b-c961-4a33-ad4a-cce76adb05eb None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.866711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b302b-c961-4a33-ad4a-cce76adb05eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:29.866832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee986c-3d26-4762-a862-a4f9021a8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:29.867012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b302b-c961-4a33-ad4a-cce76adb05eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:29.867589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee986c-3d26-4762-a862-a4f9021a8c06 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.867879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee986c-3d26-4762-a862-a4f9021a8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.868158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee986c-3d26-4762-a862-a4f9021a8c06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.868406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b302b-c961-4a33-ad4a-cce76adb05eb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:29.876559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee986c-3d26-4762-a862-a4f9021a8c06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:29.878081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee986c-3d26-4762-a862-a4f9021a8c06 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:29.885822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 323/624] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:29.887291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9ada-0855-4ccc-98e7-5eabb3dfc989 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.887611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9ada-0855-4ccc-98e7-5eabb3dfc989 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.887893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9ada-0855-4ccc-98e7-5eabb3dfc989 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.890760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 324/625] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-94ee986c-3d26-4762-a862-a4f9021a8c06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:29.894189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:29.895132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:29.896134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:29.896671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9ada-0855-4ccc-98e7-5eabb3dfc989 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:29.896753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 302/626] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:29.899340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37e1f-7518-4b49-bdd8-55925dabd342 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:29.899887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37e1f-7518-4b49-bdd8-55925dabd342 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:29.900360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37e1f-7518-4b49-bdd8-55925dabd342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:29.927312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ced37e1f-7518-4b49-bdd8-55925dabd342 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:29.928998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ced37e1f-7518-4b49-bdd8-55925dabd342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:30.003125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9ada-0855-4ccc-98e7-5eabb3dfc989 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.011564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 303/627] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:30.011564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced37e1f-7518-4b49-bdd8-55925dabd342 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.062143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.063303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.063829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.064323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.071910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.073636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:30.089283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:30.090244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:30.091137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:30.094356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 325/628] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:30.095798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.108769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced37e1f-7518-4b49-bdd8-55925dabd342 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.143329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.144039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.144325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.144603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.145448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:30.145765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.147207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.165356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 304/629] 10.222.0.55 () {56 vars in 1135 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:30.166135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.203706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58fc19-6063-4ccc-a3e0-03865f68ff94 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.239228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.240443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.240925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.241414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.253612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:30.261828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:30.262750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:30.263655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:30.271232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 326/630] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:30.272426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.272650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64891e0-5bcd-46c9-8b6a-89fb327aa9f0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.310757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.312091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.312378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.312658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.313461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:30.313772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.315220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.327754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 305/631] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:30.328607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.384748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c370917-7330-41ad-888d-3c7e9146b66d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.423031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.424239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.424741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.425212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.433531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f893da4-9c55-4240-8680-8bc74b323636 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.438001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.439784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:30.458619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:30.459677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:30.460764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:30.460764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:30.460764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:30.460764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:30.467053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 327/632] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:30.468032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.468438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.468721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.469007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.469394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.470166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:30.470476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.471942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.481023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 306/633] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:30.481902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.574574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b9fc-cc05-46cc-88ca-64dddf7eca66 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.586968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8412f3-d1c8-452c-8462-d6db09612376 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.607932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abfd62-8ea3-4063-9a58-9806de44a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.608588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abfd62-8ea3-4063-9a58-9806de44a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.608875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abfd62-8ea3-4063-9a58-9806de44a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.609147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abfd62-8ea3-4063-9a58-9806de44a2b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.609969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abfd62-8ea3-4063-9a58-9806de44a2b2 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=abbda90b98bd49569e59c973edba73b4) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:30.610305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abfd62-8ea3-4063-9a58-9806de44a2b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.611744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abfd62-8ea3-4063-9a58-9806de44a2b2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.617502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 328/634] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/role_assignments?user.id=abbda90b98bd49569e59c973edba73b4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:30.618716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e288606-b8a8-475d-a074-e166efeefd61 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.618995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e288606-b8a8-475d-a074-e166efeefd61 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.619268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e288606-b8a8-475d-a074-e166efeefd61 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.620655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 329/635] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:30.621190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e288606-b8a8-475d-a074-e166efeefd61 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.638001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c94031-9041-4f80-ac69-69d7c5983d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.640085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94031-9041-4f80-ac69-69d7c5983d91 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.641074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94031-9041-4f80-ac69-69d7c5983d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.641631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94031-9041-4f80-ac69-69d7c5983d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.642925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c94031-9041-4f80-ac69-69d7c5983d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:30.643654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c94031-9041-4f80-ac69-69d7c5983d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.645710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c94031-9041-4f80-ac69-69d7c5983d91 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.664043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 307/636] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:30.665760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46ec2-213f-4d79-ae27-15de7a255733 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.666225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46ec2-213f-4d79-ae27-15de7a255733 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.666726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46ec2-213f-4d79-ae27-15de7a255733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.690215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e8f46ec2-213f-4d79-ae27-15de7a255733 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:30.692665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e8f46ec2-213f-4d79-ae27-15de7a255733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:30.743688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e288606-b8a8-475d-a074-e166efeefd61 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.779567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 308/637] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:30.780159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ea859-a87c-4408-a8e6-c509392aac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.780778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea859-a87c-4408-a8e6-c509392aac12 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.781071 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea859-a87c-4408-a8e6-c509392aac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.781322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea859-a87c-4408-a8e6-c509392aac12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.784465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46ec2-213f-4d79-ae27-15de7a255733 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.792709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ea859-a87c-4408-a8e6-c509392aac12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.794179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ea859-a87c-4408-a8e6-c509392aac12 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8b6ea859-a87c-4408-a8e6-c509392aac12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:30.813322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:30.814272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:30.815156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:30.815156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:30.815156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:30.815156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:30.815156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 330/638] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:30.815893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31d1e-23ee-4ed6-a55c-1d0e8d5a5413 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.816071 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31d1e-23ee-4ed6-a55c-1d0e8d5a5413 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.816916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31d1e-23ee-4ed6-a55c-1d0e8d5a5413 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.817691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 331/639] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:30.818244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31d1e-23ee-4ed6-a55c-1d0e8d5a5413 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:30.903593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46ec2-213f-4d79-ae27-15de7a255733 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.931117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31d1e-23ee-4ed6-a55c-1d0e8d5a5413 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:30.934075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e8fc0-dac7-4662-9e7e-5f64af612145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.934874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8fc0-dac7-4662-9e7e-5f64af612145 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.935156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8fc0-dac7-4662-9e7e-5f64af612145 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.935434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8fc0-dac7-4662-9e7e-5f64af612145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.944219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e8fc0-dac7-4662-9e7e-5f64af612145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:30.945660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e8fc0-dac7-4662-9e7e-5f64af612145 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-a24e8fc0-dac7-4662-9e7e-5f64af612145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:30.959692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:30.960588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:30.961443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 309/640] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:30.962445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886f7e6-d3f8-43b9-9c55-c575c9463684 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.962445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886f7e6-d3f8-43b9-9c55-c575c9463684 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.962672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886f7e6-d3f8-43b9-9c55-c575c9463684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.969968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:30.970765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:30.971043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:30.971313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:30.979729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8886f7e6-d3f8-43b9-9c55-c575c9463684 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:30.980917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8886f7e6-d3f8-43b9-9c55-c575c9463684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:30.981274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:30.988874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:30.989829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 332/641] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:30.991243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.050518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 310/642] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:31.051356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886f7e6-d3f8-43b9-9c55-c575c9463684 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.117196 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a2a9-b660-4580-afd0-b29dcfd76f7f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.148848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886f7e6-d3f8-43b9-9c55-c575c9463684 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.152563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.153224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.153506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.153827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.154495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:31.155399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.156808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.168485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 333/643] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:31.169276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.187289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.187983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.188268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.188545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.189330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:31.189642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.191066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.203410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 311/644] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:31.204489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.274805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1a489-9ec2-4a0d-a87f-6b6ef4049600 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.298936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383e85e-bacc-40e0-b269-380138ef4141 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.307966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.308631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.308968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.309248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.309984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:31.310326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.312249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.328750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 334/645] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:31.328750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.336308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.337156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.337442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.337714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.347792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:31.355429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:31.356404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:31.357304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 312/646] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:31.358070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.439119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a6df2-1f1e-4c41-9eae-a78dd3ae2732 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.458213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c90ac-b207-4cfc-8a16-f4d7ded86434 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.471229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.472070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.472357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.472628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.480419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.482139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.492587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.493470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.493752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.494028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/21b75b16948240e0b3539152a63429d9/roles/572a3d7ebad94e73ac07b1b30d647dfa` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:31.497546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:31.498482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 335/647] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:31.504550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.509558 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=21b75b16948240e0b3539152a63429d9, role_id=572a3d7ebad94e73ac07b1b30d647dfa)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.511018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.597690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 313/648] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:31 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/21b75b16948240e0b3539152a63429d9/roles/572a3d7ebad94e73ac07b1b30d647dfa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:31.597690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.625927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246bfd8-144b-4b73-9679-39492cc08468 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.663462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.664478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.665189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.678325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.680124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:31.704007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:31.705041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:31.706024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:31.706024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:31.706024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:31.706024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:31.706024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 336/649] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:31.706024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.706366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be329-da4d-4599-b02d-0775c531eabf None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.755834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.756710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.757141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.757599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.758531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:31.759050 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.760779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.770232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 314/650] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:31.771660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.818543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d948fa-35d4-446d-a6ec-b0f9a64c49ca None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.861826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.862914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.863398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.863955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.864994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:31.865502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.867243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.886964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 337/651] 10.222.0.55 () {56 vars in 1137 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:31.888394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:31.896250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09269c1a-0c85-4642-98da-021cb257ec7c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:31.930596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:31.931261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:31.931577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:31.931856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:31.932581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:31.932888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:31.934479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:31.950770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 315/652] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:31.950770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.001217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba088d33-7d85-47c7-8452-d363adbbc9e5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.035742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.036874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.037375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.037860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.051446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.053389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.053842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb5852-198a-4082-90ac-51b184956e48 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:32.077628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:32.078774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:32.079917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:32.079917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:32.079917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:32.079917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:32.082556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 338/653] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:32.083584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.100564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.101496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.102104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.102541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.180006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.181764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.185351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b1b3-0870-4456-bf54-2d50ca301d5f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.223492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.223492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.223492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.223492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.229154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.230694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:32.245797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:32.246767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:32.248006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 339/654] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:32.249716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.285347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 316/655] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:32.286227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.357670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ad92-ffa4-460c-b9c9-c5a6008b94c8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.385640 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa282aa-4356-4eff-a5fc-90b8b836a331 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.392392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.393067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.393349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.393626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.394342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:32.394651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.396056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.412434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 340/656] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:32.413410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.422427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.423138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.423425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.423731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.424583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:32.424895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.426355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.521238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5df29-ddc6-48d0-818c-e35982a5cb30 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.557121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.557859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.558142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.558421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.570476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.572007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.586097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 317/657] 10.222.0.55 () {56 vars in 1139 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:32.587025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:32.593357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:32.595533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:32.597619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:32.597619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:32.597619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:32.597619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:32.597619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 341/658] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:32.603489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.692045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a751-8405-4c47-8050-191754f5eefb None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.706104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2178aca-5da1-4a8f-a3c6-e33147aae691 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.727674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.728481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.728765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.729042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.741490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.741490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.747501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.747501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.747501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.747501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:32.754642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:32.756947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 318/659] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:32.759181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.817938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.819816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.867045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811fe95-30f8-4ee5-be76-fafabbf73d88 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:32.903673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:32.904460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:32.904868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:32.905252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:32.906205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:32.906581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:32.908907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:32.923942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 319/660] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:32.924877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:32.930824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 342/661] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:32.932206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.040958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112870-f3e5-42d4-beca-79a25da81b3c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.051118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0e2ca-23f0-45fa-bd65-fd85ee7aac2f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.076074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.077347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.077626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.077896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.084369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dc8e0-919c-40b6-b6d5-d2890363cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.084518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.085035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc8e0-919c-40b6-b6d5-d2890363cea0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.085313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc8e0-919c-40b6-b6d5-d2890363cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.085583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc8e0-919c-40b6-b6d5-d2890363cea0 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.085896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.086446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dc8e0-919c-40b6-b6d5-d2890363cea0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:33.086720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dc8e0-919c-40b6-b6d5-d2890363cea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.088147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dc8e0-919c-40b6-b6d5-d2890363cea0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:33.099978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:33.100928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:33.101831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 343/662] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:33.103033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.110990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 320/663] 10.222.0.55 () {56 vars in 1137 bytes} [Thu May 5 15:10:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:33.118499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656874d0-9bf8-4351-ad56-7bc530dd9b8d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.118499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656874d0-9bf8-4351-ad56-7bc530dd9b8d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.118499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656874d0-9bf8-4351-ad56-7bc530dd9b8d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.118499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 321/664] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:33.118499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656874d0-9bf8-4351-ad56-7bc530dd9b8d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.207283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde01b9-8c3c-4a48-90ee-b8d006dbfbe7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.219228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656874d0-9bf8-4351-ad56-7bc530dd9b8d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.240052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673228bb-7b0e-4fd4-9518-f5152f9c7218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.240840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673228bb-7b0e-4fd4-9518-f5152f9c7218 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.241121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673228bb-7b0e-4fd4-9518-f5152f9c7218 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.241388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673228bb-7b0e-4fd4-9518-f5152f9c7218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.252538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673228bb-7b0e-4fd4-9518-f5152f9c7218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.253425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.253996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673228bb-7b0e-4fd4-9518-f5152f9c7218 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.254097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.254366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.254644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.255432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:33.255776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.257175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.268566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 322/665] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:33.269367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-673228bb-7b0e-4fd4-9518-f5152f9c7218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:33.272389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:33.273270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:33.274193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:33.274193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:33.274193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:33.274193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:33.278276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 344/666] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:33.279512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd733f6-c258-4923-8b67-59599a3b0ad5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.279862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd733f6-c258-4923-8b67-59599a3b0ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.280137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd733f6-c258-4923-8b67-59599a3b0ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.299336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2dd733f6-c258-4923-8b67-59599a3b0ad5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:33.300559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2dd733f6-c258-4923-8b67-59599a3b0ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:33.367594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 345/667] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:33.367594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd733f6-c258-4923-8b67-59599a3b0ad5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.382169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe8b3-7417-4326-b165-b95f7d1344fc None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.423775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.424439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.424726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.425001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.470512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd733f6-c258-4923-8b67-59599a3b0ad5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.493255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.494686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.505799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.506455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.506734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.507006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.507857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=fd89045deca342e5a4a6fa39c5bde4c4) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:33.508169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.509583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.515630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 346/668] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/role_assignments?user.id=fd89045deca342e5a4a6fa39c5bde4c4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:33.516414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.637065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc7f74-8d10-4398-b8dc-775dbb8d9b53 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.641232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 323/669] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:33.643330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.674520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.675198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.675500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.675772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.676499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:33.676801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.678276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.696533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 347/670] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:33.697593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.760496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341223-1d0d-40ed-a6f1-8df67e86d359 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.801068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.802226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.802711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.803210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.812773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3115a23-23e6-4ab8-8df3-66a01ba56ee3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.816146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:33.824201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:33.825231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:33.826108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:33.829660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 324/671] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:33.830929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.865513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.869386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.869686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.869967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.882861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.884665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:33.909477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:33.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:33.911937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:33.911937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:33.911937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:33.911937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:33.911937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 348/672] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:33.911937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:33.939817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed3c4-c557-48bf-92ff-5d56ab6fbdf1 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:33.977522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:33.978976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:33.979459 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:33.979953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:33.988774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:33.990515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:34.004439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:34.005364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:34.006253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:34.012873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 325/673] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:34.014651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.039306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31596b3a-153c-46a6-9540-0552a9b0ad58 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.074522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711fe4c-ce98-4c30-a99f-1339eb341547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.075283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711fe4c-ce98-4c30-a99f-1339eb341547 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.075499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711fe4c-ce98-4c30-a99f-1339eb341547 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.075771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711fe4c-ce98-4c30-a99f-1339eb341547 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.077049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711fe4c-ce98-4c30-a99f-1339eb341547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:34.077351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711fe4c-ce98-4c30-a99f-1339eb341547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.078719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711fe4c-ce98-4c30-a99f-1339eb341547 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.091337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 349/674] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:34.091337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40176-02ef-4280-b9b0-b1b7504b4a03 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.091337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40176-02ef-4280-b9b0-b1b7504b4a03 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.091337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40176-02ef-4280-b9b0-b1b7504b4a03 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.091337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 350/675] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:34.091337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a40176-02ef-4280-b9b0-b1b7504b4a03 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.116501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064e99-1deb-483e-8380-09b89de42272 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.148612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.149270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.149551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.149824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.150537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:34.150832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.152197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.164187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 326/676] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:34.164918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.196763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a40176-02ef-4280-b9b0-b1b7504b4a03 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.229147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bbbcd-52a5-432e-aca6-1b7ac3509f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.229828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bbbcd-52a5-432e-aca6-1b7ac3509f75 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.230113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bbbcd-52a5-432e-aca6-1b7ac3509f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.230391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bbbcd-52a5-432e-aca6-1b7ac3509f75 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.231158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bbbcd-52a5-432e-aca6-1b7ac3509f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:34.231474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bbbcd-52a5-432e-aca6-1b7ac3509f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.232925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bbbcd-52a5-432e-aca6-1b7ac3509f75 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.244428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 351/677] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:34.245632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8d0f2-9b4f-458a-8a0f-eb43368b182f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.245918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8d0f2-9b4f-458a-8a0f-eb43368b182f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.246194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8d0f2-9b4f-458a-8a0f-eb43368b182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.263330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b5c8d0f2-9b4f-458a-8a0f-eb43368b182f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:34.266292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b5c8d0f2-9b4f-458a-8a0f-eb43368b182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:34.270062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a968-c1bf-4f8e-8c81-c4124a60e20f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.312642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.313425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.313705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.313977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.324099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.325548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:34.343164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:34.344102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:34.352265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:34.352265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:34.352265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:34.352265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:34.352550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 352/678] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:34.352550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8d0f2-9b4f-458a-8a0f-eb43368b182f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.352714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 327/679] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:34.352714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.448828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8d0f2-9b4f-458a-8a0f-eb43368b182f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.455232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc76a6a-dd21-4a91-9a9a-8728be3eefa7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.488085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.488323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.488738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.488929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.489010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.489173 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.489268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.489425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.490134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=9c25e83af7604455bad1d7c0ee1c0122) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:34.490408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.491856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.496337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.497771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.498221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 328/680] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/role_assignments?user.id=9c25e83af7604455bad1d7c0ee1c0122&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:34.498901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:34.523077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:34.524073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:34.524950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:34.527659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 353/681] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:34.528988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.615995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f70d9-f699-41dd-ba19-1f86b3672c12 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.646906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1860-d512-41d7-9428-e0bb1905b70f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.661554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.662234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.662520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.662798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.663562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:34.663872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.665263 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.684192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 329/682] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:34.685188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.692359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.693549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.694059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.694533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.707103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:34.715923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:34.716856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:34.717723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:34.721272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 354/683] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:34.723558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.793073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ed18-be56-4c97-b18e-002473cc0456 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.827358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.828058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.828336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.828607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.829448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:34.829757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.831175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.843248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 330/684] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:34.844115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.846093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b090cb-577c-4195-b2fd-7f6b3c3d9e91 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.880758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.881916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.882397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.882864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.891576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.893327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:34.908064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:34.909017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:34.909948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:34.912589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 355/685] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:34.913677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:34.942986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8feff-2514-4ae0-9e6e-06b08832f869 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:34.981545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:34.982238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:34.982417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:34.982772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:34.983562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:34.983868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:34.985231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:34.993690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 331/686] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:34.994523 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.020106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118d9a-5c6a-4dd7-aea4-86ed89e2d6dc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.053465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.054453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.054935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.055409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.056435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=fc69b41ea4d6456f9532cee386265e61) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:35.056980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.058616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.065487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 356/687] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/role_assignments?user.id=fc69b41ea4d6456f9532cee386265e61&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:35.066599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.100864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840ac7-843f-411f-9cbe-70903ae06caa None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.161815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.162501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.162778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.163049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.163996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:35.164304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.165756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.199643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 332/688] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:10:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:35.205916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21260f0c-b99b-48b4-98d2-4638d1f0b615 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.208314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.280060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.281220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.281706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.282180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.293612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.296074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:35.315678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:35.316653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:35.317534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:35.317534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:35.317534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:35.317534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:35.319845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 357/689] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:35.326614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.353808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e182b-6348-43ae-a439-cdcd236e85c3 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.389691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653713-f803-4795-8616-2c7660f339db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.390354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653713-f803-4795-8616-2c7660f339db None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.390843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653713-f803-4795-8616-2c7660f339db None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.390950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653713-f803-4795-8616-2c7660f339db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.432881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b08ba-7f9f-4316-a5b7-955dbd2949b6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.467018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653713-f803-4795-8616-2c7660f339db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.468479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653713-f803-4795-8616-2c7660f339db None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.476132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.477123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.477623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.478107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.479026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:35.479589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.481180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.499239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 358/690] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:35.501483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.578399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 333/691] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:35.584145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653713-f803-4795-8616-2c7660f339db None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.627184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dbee1-f7fa-4697-a64d-f0234dffdbbf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.665981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.667102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.667102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.667298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.674762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.676243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:35.690999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:35.697919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 359/692] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:35.698880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.700606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653713-f803-4795-8616-2c7660f339db None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.754662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.755872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.755872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.756143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.771295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.772804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:35.795615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:35.796591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:35.797937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:35.797937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:35.797937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:35.797937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:35.797937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 334/693] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:35.804155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.839141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809d2db-520a-4d03-a628-3317e2a21e4d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.882858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.884243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.885026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.885517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.886749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:35.887681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.890363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.906423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acf9f7-fa10-4a11-aaaf-ff206ee940ac None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:35.913964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 360/694] 10.222.0.55 () {56 vars in 1135 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:35.920885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:35.956053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a52db-e70e-4369-ad16-d29197f406e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:35.956725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a52db-e70e-4369-ad16-d29197f406e3 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.957016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a52db-e70e-4369-ad16-d29197f406e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.957303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a52db-e70e-4369-ad16-d29197f406e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.958037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a52db-e70e-4369-ad16-d29197f406e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:35.958345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a52db-e70e-4369-ad16-d29197f406e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:35.959753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a52db-e70e-4369-ad16-d29197f406e3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:35.972891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 335/695] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:35.975908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815cdb-f703-459e-beba-ca02a9373d1e None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:35.975908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815cdb-f703-459e-beba-ca02a9373d1e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:35.975908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815cdb-f703-459e-beba-ca02a9373d1e None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:35.976372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 336/696] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:35.981174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc815cdb-f703-459e-beba-ca02a9373d1e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.045939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830f46-56a5-4168-93c5-4048b7fe6c5d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.090305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.091045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.091669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.092127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.094948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc815cdb-f703-459e-beba-ca02a9373d1e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.130153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2209-6563-456b-be18-dc62730b9082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.131116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2209-6563-456b-be18-dc62730b9082 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.131484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2209-6563-456b-be18-dc62730b9082 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.131822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2209-6563-456b-be18-dc62730b9082 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.142858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2209-6563-456b-be18-dc62730b9082 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.144463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2209-6563-456b-be18-dc62730b9082 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-b0dd2209-6563-456b-be18-dc62730b9082 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:36.159411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:36.161462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:36.163716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:36.169550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 337/697] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:36.169550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038c1d-6a7f-4d88-b391-c8232753f2db None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.169550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038c1d-6a7f-4d88-b391-c8232753f2db None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.169550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038c1d-6a7f-4d88-b391-c8232753f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.172958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.174435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.186413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7b038c1d-6a7f-4d88-b391-c8232753f2db None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:36.187650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7b038c1d-6a7f-4d88-b391-c8232753f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:36.253210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 338/698] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:36.254074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b038c1d-6a7f-4d88-b391-c8232753f2db None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.310167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 361/699] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:10:36.311835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.371248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b038c1d-6a7f-4d88-b391-c8232753f2db None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.411716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.412422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.412797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.413170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.414222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:36.414536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.416016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.431672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 339/700] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:36.432541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.438317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0cf0-c9b4-4ec4-82b4-7d39641ec698 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.472981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.473800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.474079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.474350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.475006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.476440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:36.490947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:36.493287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:36.495331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 362/701] 10.222.0.55 () {56 vars in 1129 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:36.496901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.564759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb724b52-6920-4a78-bd98-80b0c0841f32 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.596889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4982c3c-6313-4326-9112-72d906a674ad None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.606988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.608213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.608506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.608788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.622780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.625469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.631978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.632749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.633146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.633518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.634443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=abbda90b98bd49569e59c973edba73b4) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:36.634854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.636414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:36.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:36.654617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:36.656769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:36.656769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:36.656769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:36.656769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:36.656769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 340/702] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:36.657408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 363/703] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/role_assignments?user.id=abbda90b98bd49569e59c973edba73b4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:36.657554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.657705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.763716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f824f98-66c8-4be4-8fd7-b44727252623 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.810312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.813036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.813365 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.813653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.814423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:36.814740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.816233 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.832222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 341/704] 10.222.0.55 () {56 vars in 1124 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:36.841602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:36.876829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69518617-75ee-42cc-8093-1ceb98fccb6b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:36.922298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:36.922988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:36.923273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:36.923576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:36.924309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:36.924617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:36.925993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:36.944032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 364/705] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:36.955836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:37.052826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d1d2-d983-4408-8c89-2e19e3cb3c4e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:37.082276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c9cf7-40e1-43a5-ae4f-2dee980245f8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:37.087918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4a86d-3319-494b-934a-20c02a0af2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:37.088590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4a86d-3319-494b-934a-20c02a0af2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.088872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4a86d-3319-494b-934a-20c02a0af2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.089149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4a86d-3319-494b-934a-20c02a0af2a2 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.089858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4a86d-3319-494b-934a-20c02a0af2a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:37.090165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4a86d-3319-494b-934a-20c02a0af2a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:37.091551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4a86d-3319-494b-934a-20c02a0af2a2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:37.098225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 342/706] 10.222.0.55 () {56 vars in 1124 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:37.099529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505e8d6-aa62-4824-a02e-579a24935b93 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.099821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505e8d6-aa62-4824-a02e-579a24935b93 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.100101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505e8d6-aa62-4824-a02e-579a24935b93 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.105568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 343/707] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:37.107064 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3377-3cd4-4a53-9ad2-e485d5797849 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.107357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3377-3cd4-4a53-9ad2-e485d5797849 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.108203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3377-3cd4-4a53-9ad2-e485d5797849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.131695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-358b3377-3cd4-4a53-9ad2-e485d5797849 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:37.133580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-358b3377-3cd4-4a53-9ad2-e485d5797849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:37.136291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:37.137123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.137405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.137681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.153361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:37.154999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:37.182670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:37.183667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:37.184565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 365/708] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:37.190523 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:37.275718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 344/709] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:37.321929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3377-3cd4-4a53-9ad2-e485d5797849 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:37.340932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f98094-5fc1-4125-8165-c9cddc2e64a6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:37.385379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:37.385971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.386250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.386516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.387303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:37.387640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:37.389376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:37.403970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 366/710] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:37.411742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:37.449658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3377-3cd4-4a53-9ad2-e485d5797849 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:37.497628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:37.498466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.498748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.499025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] PATH_INFO: `/v3/services/network` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.499710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:37.501085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:37.522915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:37.525221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:37.527284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:37.537041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 345/711] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:37 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:37.542885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:37.596300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b1a7f-a023-40ae-857c-8c04a30ebbd1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:37.642170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:37.642760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.643043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.643317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.644169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=21b75b16948240e0b3539152a63429d9) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:37.644480 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:37.645909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:37.662704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 367/712] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:37 2022] GET /identity/v3/role_assignments?user.id=21b75b16948240e0b3539152a63429d9&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:37.713522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86238db-c7c1-4bef-bbe9-103d866bc086 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:37.754985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cded1-5737-4833-9117-b4a30da250ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:37.755692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cded1-5737-4833-9117-b4a30da250ad None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.755981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cded1-5737-4833-9117-b4a30da250ad None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.756262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cded1-5737-4833-9117-b4a30da250ad None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.756982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cded1-5737-4833-9117-b4a30da250ad None admin] RBAC: Adding query filter params (name=network) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:37.757290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cded1-5737-4833-9117-b4a30da250ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:37.758660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cded1-5737-4833-9117-b4a30da250ad None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:37.767861 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 346/713] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:10:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:37.769714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:37.892756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769d6ae-dc5d-4ae9-8c52-c9f9c939ed19 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:37.932680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa1dbb-2249-4554-8eb5-f7bea61b59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:37.933364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1dbb-2249-4554-8eb5-f7bea61b59be None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:37.933648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1dbb-2249-4554-8eb5-f7bea61b59be None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:37.933925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1dbb-2249-4554-8eb5-f7bea61b59be None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:37.934638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa1dbb-2249-4554-8eb5-f7bea61b59be None admin] RBAC: Adding query filter params (type=network) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:37.934947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa1dbb-2249-4554-8eb5-f7bea61b59be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:37.936379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa1dbb-2249-4554-8eb5-f7bea61b59be None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:37.942703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 368/714] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:10:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:38.193889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed17f-ff1b-4afb-9825-71acf4df9902 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:38.194560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed17f-ff1b-4afb-9825-71acf4df9902 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:38.194560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed17f-ff1b-4afb-9825-71acf4df9902 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:38.195750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 347/715] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:38.202384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf99b8e-995b-4712-ac82-4164c456420d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:38.202718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf99b8e-995b-4712-ac82-4164c456420d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:38.202944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf99b8e-995b-4712-ac82-4164c456420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:38.221754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-dcf99b8e-995b-4712-ac82-4164c456420d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:38.222950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dcf99b8e-995b-4712-ac82-4164c456420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:38.307874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 369/716] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:38.331113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ed17f-ff1b-4afb-9825-71acf4df9902 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:38.460420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ed17f-ff1b-4afb-9825-71acf4df9902 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:38.499369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:38.500200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:38.500486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:38.500765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:38.511357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:38.512822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:38.530752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:38.531727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:38.532866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:38.532866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:38.532866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:38.532866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:38.532866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 348/717] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:38.540630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf99b8e-995b-4712-ac82-4164c456420d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:38.648904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf99b8e-995b-4712-ac82-4164c456420d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:38.687447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051add85-d507-4f7f-a438-cbe737678cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:38.688143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051add85-d507-4f7f-a438-cbe737678cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:38.688486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051add85-d507-4f7f-a438-cbe737678cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:38.688766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051add85-d507-4f7f-a438-cbe737678cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:38.689538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051add85-d507-4f7f-a438-cbe737678cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:38.689851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051add85-d507-4f7f-a438-cbe737678cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:38.691230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051add85-d507-4f7f-a438-cbe737678cb7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:38.702938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 370/718] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:38.708674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:38.809580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064413ea-979c-48d2-8a6d-e4c435c773a9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:38.846834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2b8d-30a4-4e4f-89df-44a2fa397f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:38.847917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2b8d-30a4-4e4f-89df-44a2fa397f29 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:38.848418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2b8d-30a4-4e4f-89df-44a2fa397f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:38.848894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2b8d-30a4-4e4f-89df-44a2fa397f29 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:38.849796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2b8d-30a4-4e4f-89df-44a2fa397f29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:38.851431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2b8d-30a4-4e4f-89df-44a2fa397f29 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:38.958862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 349/719] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:10:38 2022] POST /identity/v3/users => generated 254 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:39.341394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f7d8-4ba7-4ebb-a8f9-f2554b0c2720 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:39.341681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f7d8-4ba7-4ebb-a8f9-f2554b0c2720 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:39.342265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f7d8-4ba7-4ebb-a8f9-f2554b0c2720 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:39.344146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 371/720] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:39.349967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321272-3db5-40d5-b747-6c8a1c2a32f3 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:39.350974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321272-3db5-40d5-b747-6c8a1c2a32f3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:39.351500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321272-3db5-40d5-b747-6c8a1c2a32f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:39.372292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b0321272-3db5-40d5-b747-6c8a1c2a32f3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:39.374404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b0321272-3db5-40d5-b747-6c8a1c2a32f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:39.464074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 350/721] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:39.501193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f7d8-4ba7-4ebb-a8f9-f2554b0c2720 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:39.609313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f7d8-4ba7-4ebb-a8f9-f2554b0c2720 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:39.648921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab216e-de69-4d49-bcd5-5ad461455144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:39.650101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab216e-de69-4d49-bcd5-5ad461455144 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:39.666800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab216e-de69-4d49-bcd5-5ad461455144 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:39.666800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab216e-de69-4d49-bcd5-5ad461455144 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:39.666800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab216e-de69-4d49-bcd5-5ad461455144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a7ab216e-de69-4d49-bcd5-5ad461455144 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:39.670037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:39.670961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:39.671938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:39.674262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 372/722] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:39.680225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0321272-3db5-40d5-b747-6c8a1c2a32f3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:39.794267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0321272-3db5-40d5-b747-6c8a1c2a32f3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:39.822438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28183-2de4-4f49-bf8c-b12de94e1738 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:39.822734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28183-2de4-4f49-bf8c-b12de94e1738 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:39.823018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28183-2de4-4f49-bf8c-b12de94e1738 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:39.825282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 373/723] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:39.831696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719e0d-8cd6-4c90-bde8-02ba606727cb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:39.831991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719e0d-8cd6-4c90-bde8-02ba606727cb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:39.832274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719e0d-8cd6-4c90-bde8-02ba606727cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:39.836043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:39.836884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:39.837396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:39.837853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:39.838745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:39.839206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:39.840734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:39.850484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ee719e0d-8cd6-4c90-bde8-02ba606727cb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:39.852178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ee719e0d-8cd6-4c90-bde8-02ba606727cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:39.862082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 351/724] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:39.868822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:39.977667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33003fd-4df6-4ba1-92d6-ffde92bd3c1f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:40.014385 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:40.015697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.016243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.016725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.029264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:40.031633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:40.050378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:40.051408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:40.052397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:40.052397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:40.052397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:40.052397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:40.054823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 352/725] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:40.060825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:40.167377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae0d16-e1b4-4624-91ec-2a487302aace None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:40.212066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:40.213146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.213639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.214121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.215055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:40.216684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:40.218831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:40.247420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 353/726] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:40.252403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 374/727] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:40.265990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:40.310825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee719e0d-8cd6-4c90-bde8-02ba606727cb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:40.384841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e74cd-52e5-4b5f-aa54-4d5c1ec0f0ff None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:40.472861 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:40.473587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.473866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.474137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.479600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee719e0d-8cd6-4c90-bde8-02ba606727cb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:40.492714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:40.494327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:40.516679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168cdc4-1225-45dd-a60a-84e24d197520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:40.517402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cdc4-1225-45dd-a60a-84e24d197520 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.517695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cdc4-1225-45dd-a60a-84e24d197520 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.517968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cdc4-1225-45dd-a60a-84e24d197520 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.518774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168cdc4-1225-45dd-a60a-84e24d197520 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:40.520285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168cdc4-1225-45dd-a60a-84e24d197520 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:40.525986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:40.527035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:40.528020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 354/728] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:10:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:40.534839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:40.646323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303c968-5209-42d5-8334-31bbb1071874 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:40.657712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 375/729] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:10:40 2022] POST /identity/v3/services => generated 251 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:10:40.705882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:40.706590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.706870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.707146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.708149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:40.708454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:40.709894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:40.726961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487e9db-46e8-4cdc-a48f-25a620ed7ac1 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.727282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487e9db-46e8-4cdc-a48f-25a620ed7ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.727525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487e9db-46e8-4cdc-a48f-25a620ed7ac1 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.729345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 376/730] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:40.734368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 355/731] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:10:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:40.736281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05582-ed05-4390-a0ba-9e62509ceef2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.736830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05582-ed05-4390-a0ba-9e62509ceef2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.737343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05582-ed05-4390-a0ba-9e62509ceef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.744328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:40.779990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9ff05582-ed05-4390-a0ba-9e62509ceef2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:40.781598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9ff05582-ed05-4390-a0ba-9e62509ceef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:40.857904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d807286-d4ee-43d9-81a5-ffe92671c6c0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:40.881488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 377/732] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:10:40.889756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fa3ee-6f02-43ee-b951-91bd922bd167 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.890309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fa3ee-6f02-43ee-b951-91bd922bd167 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.890818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fa3ee-6f02-43ee-b951-91bd922bd167 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.892761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 378/733] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:40.895441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:40.896489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.896685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.896963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.897682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9cbb2-3b67-4c9a-aa90-e3507e4ec33b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:40.898003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9cbb2-3b67-4c9a-aa90-e3507e4ec33b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:40.898254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9cbb2-3b67-4c9a-aa90-e3507e4ec33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:40.909205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:40.910644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:40.928806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:40.929766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:40.930714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:40.930714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:40.930714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:40.930714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:40.930942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-40b9cbb2-3b67-4c9a-aa90-e3507e4ec33b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:40.930942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-40b9cbb2-3b67-4c9a-aa90-e3507e4ec33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:40.934457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 356/734] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:40.935336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.015343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 379/735] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:10:41.016888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9cbb2-3b67-4c9a-aa90-e3507e4ec33b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.058755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5cd78-1daa-4970-b73a-bb0d854e7abc None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.101775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.102938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.103238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.103548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.116895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:41.127298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9cbb2-3b67-4c9a-aa90-e3507e4ec33b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:41.127740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:41.128652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:41.129509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 357/736] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:41.130200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.170632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.171499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.171629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.171989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.172732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:41.173028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:41.174404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:41.186777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 380/737] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:41.187728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.268939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb9c2-3983-41de-aa07-f1c476c277e1 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.293791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a60c9-07ef-4b7c-ab3d-3c08b35c12f0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.311554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.312736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.313526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.314013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.314944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:41.317020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:41.329958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.330718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.331079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.331455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.332376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:41.332780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:41.334140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:41.344190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 381/738] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:41.348418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.410396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 358/739] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:10:41 2022] POST /identity/v3/services => generated 240 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:41.412692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.492351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3084-8473-4629-a168-63f9110058aa None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.584849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.585776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.585982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.586210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.604865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:41.606334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:41.607019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6143a1-ea97-49b1-92ea-5616e0690cc1 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:41.630013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:41.630955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:41.631933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 382/740] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:41.636832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.668956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.670015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.670179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.670881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.685058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:41.686693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:41.705667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:41.706654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:41.707567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:41.707567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:41.707567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:41.707567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:41.707567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 359/741] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:41.721484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.751421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ce5c0-e199-440b-955d-2a8d266b3d8e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.787490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.788530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.788988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.789442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.790414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:41.790928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:41.792589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:41.806263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 383/742] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:41.813591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.839867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a8f6-9478-4ac4-be12-4d825139d338 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:41.880252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:41.880932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:41.881215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:41.881485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:41.882209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:41.882509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:41.884041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:41.898160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 360/743] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:41.910065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:41.979605 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0206-2228-48b3-b58d-a7fd0eaf2747 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:42.022626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab3cdc-1b7d-4d58-af18-e49c0efd3447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:42.023549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3cdc-1b7d-4d58-af18-e49c0efd3447 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.023830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3cdc-1b7d-4d58-af18-e49c0efd3447 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.024100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3cdc-1b7d-4d58-af18-e49c0efd3447 None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/abbda90b98bd49569e59c973edba73b4/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.026064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab3cdc-1b7d-4d58-af18-e49c0efd3447 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=abbda90b98bd49569e59c973edba73b4, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:42.027507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab3cdc-1b7d-4d58-af18-e49c0efd3447 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:42.056973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a93e95-48a3-4c8e-98cd-afcea60a52aa None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:42.100027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:42.101242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.101834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.102368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.116264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 384/744] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:41 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/abbda90b98bd49569e59c973edba73b4/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:42.117978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb9c8-6156-4ca5-b7ea-bbe155be29d4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.118560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb9c8-6156-4ca5-b7ea-bbe155be29d4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.119138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb9c8-6156-4ca5-b7ea-bbe155be29d4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.122216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 385/745] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:42.125852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:42.128612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56bed-c9d1-46d0-ad95-4cd2618fbc01 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.129192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56bed-c9d1-46d0-ad95-4cd2618fbc01 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.129705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56bed-c9d1-46d0-ad95-4cd2618fbc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.132376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:42.165727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:42.167085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:42.168136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:42.170941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b7a56bed-c9d1-46d0-ad95-4cd2618fbc01 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:42.172649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b7a56bed-c9d1-46d0-ad95-4cd2618fbc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:42.177299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 361/746] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:42.180340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:42.340697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc85d8-671c-4a27-b89d-dd041452eb9e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:42.353513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 386/747] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:10:42.381930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56bed-c9d1-46d0-ad95-4cd2618fbc01 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:42.384723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:42.387511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.388065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.389123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.391109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:42.392810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:42.396810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:42.435349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 362/748] 10.222.0.55 () {56 vars in 1135 bytes} [Thu May 5 15:10:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:42.444583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:42.569564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2ef59-0c22-4274-bf9a-a1171c641571 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:42.586045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56bed-c9d1-46d0-ad95-4cd2618fbc01 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:42.611298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:42.611921 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.612210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.612490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.684230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:42.692541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.692541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.692541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.692828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:42.692828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:42.721049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:42.734785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:42.735850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:42.736707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:42.749052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 387/749] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:42.759627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:42.804099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 363/750] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:10:42.816525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:42.887232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e161e-eb2a-46d7-9aa7-58bac375f3f9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:42.933588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:42.934275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.934564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.934843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:42.935672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:42.935973 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:42.937354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:42.952897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178db82-1718-4c50-a8c5-ef087c725a9e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:42.954834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 388/751] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:42.960515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:42.988799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:42.989603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:42.989887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:42.990162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.000788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.002252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:43.021584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:43.022543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:43.023875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:43.023875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:43.023875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:43.023875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:43.023875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 364/752] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:43.032495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.093931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdb4c9-fdef-47a9-8c38-0c8abab8d267 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.129295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.130095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.130380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.130657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.142866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.144288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:43.163483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:43.165625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:43.167799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:43.167799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:43.167799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:43.167799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:43.167799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 389/753] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:43.171597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.239328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a26eaa-44b0-4f0d-9b05-f17a1cc71c42 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.300115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea64f0-e5cb-436b-b487-a02e8f660938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.300797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea64f0-e5cb-436b-b487-a02e8f660938 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.301084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea64f0-e5cb-436b-b487-a02e8f660938 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.301366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea64f0-e5cb-436b-b487-a02e8f660938 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.302106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea64f0-e5cb-436b-b487-a02e8f660938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:43.302419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea64f0-e5cb-436b-b487-a02e8f660938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.303945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea64f0-e5cb-436b-b487-a02e8f660938 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.306597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e35d8-c07e-41ef-bb33-e27aac85edd9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.317211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 365/754] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:43.318588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9e1f-37c6-44e2-b659-e332a89095f6 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.318884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9e1f-37c6-44e2-b659-e332a89095f6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.319164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9e1f-37c6-44e2-b659-e332a89095f6 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.320698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 366/755] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:43.322555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c9e1f-37c6-44e2-b659-e332a89095f6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.351541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e41b6-b236-416b-87c0-e63cda879499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.352320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e41b6-b236-416b-87c0-e63cda879499 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.352607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e41b6-b236-416b-87c0-e63cda879499 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.352937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e41b6-b236-416b-87c0-e63cda879499 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.353667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e41b6-b236-416b-87c0-e63cda879499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:43.353974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e41b6-b236-416b-87c0-e63cda879499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.355368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e41b6-b236-416b-87c0-e63cda879499 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.373810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 390/756] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:43.375344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb754d-095c-4b22-8e0b-ff9488598feb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.375660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb754d-095c-4b22-8e0b-ff9488598feb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.375937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb754d-095c-4b22-8e0b-ff9488598feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.393218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-25eb754d-095c-4b22-8e0b-ff9488598feb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:43.394396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-25eb754d-095c-4b22-8e0b-ff9488598feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:43.429926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c9e1f-37c6-44e2-b659-e332a89095f6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.465567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 391/757] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:43.467962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb754d-095c-4b22-8e0b-ff9488598feb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.476144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.476971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.477257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.477537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.491154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.492678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:43.515582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:43.516533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:43.517464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:43.524140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 367/758] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:43.524826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.612105 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb754d-095c-4b22-8e0b-ff9488598feb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.635683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128790-4be0-4c57-8ae1-7f428f9b86a9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.661814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.661814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.661814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.661814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.662226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.662226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:43.677018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:43.678020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:10:43.678969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:43.680053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.680053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.680053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.680053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.680345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.681001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.682381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 392/759] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:43.683458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:43.698925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:43.709668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:43.710552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 368/760] 10.222.0.55 () {56 vars in 1129 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:43.711418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.808774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e18224-245d-4445-ad16-823b8711ae21 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.835414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24876-7a1f-4b06-b629-a56c58fbf796 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:43.846893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.848008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.848518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.848996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.849994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:43.850509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.852197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.865219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 393/761] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:43.866347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.880387 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:43.881432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:43.881941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:43.882435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:43.883510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:43.884046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:43.885787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:43.909434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 369/762] 10.222.0.55 () {56 vars in 1149 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:43.910689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:43.996505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6a428-c4fd-471a-9812-7b2622a2ad23 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.019225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db8dd9-9621-4a75-b18c-b8854a0158e0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.041860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.042553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.042838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.043803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.044564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:44.044909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.046625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:44.053236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 394/763] 10.222.0.55 () {56 vars in 1124 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:44.058860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:44.066164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.067212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.067794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.068279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.069419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=21b75b16948240e0b3539152a63429d9) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:44.069957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.071677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:44.078812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 370/764] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:43 2022] GET /identity/v3/role_assignments?user.id=21b75b16948240e0b3539152a63429d9&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:44.080033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:44.242670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1384-85a1-4373-b96e-53d0b7df7583 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.274014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f558-7891-4c09-b9df-2f08f2ffdbc8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.280342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a375ea-b49a-45e6-8399-4067094ff898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.281398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a375ea-b49a-45e6-8399-4067094ff898 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.281915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a375ea-b49a-45e6-8399-4067094ff898 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.282397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a375ea-b49a-45e6-8399-4067094ff898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.312455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b6558-fb00-4bfb-99b5-91811d6b0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.313122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6558-fb00-4bfb-99b5-91811d6b0d8f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.313409 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6558-fb00-4bfb-99b5-91811d6b0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.313682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6558-fb00-4bfb-99b5-91811d6b0d8f None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.314394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b6558-fb00-4bfb-99b5-91811d6b0d8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:44.314726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b6558-fb00-4bfb-99b5-91811d6b0d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.316091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b6558-fb00-4bfb-99b5-91811d6b0d8f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:44.321364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 371/765] 10.222.0.55 () {56 vars in 1124 bytes} [Thu May 5 15:10:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:44.322657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9475a1a-978a-4277-8080-e3f6b14b3e82 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.322943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9475a1a-978a-4277-8080-e3f6b14b3e82 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.323217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9475a1a-978a-4277-8080-e3f6b14b3e82 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.328594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 372/766] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:44.329513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9475a1a-978a-4277-8080-e3f6b14b3e82 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:44.364244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a375ea-b49a-45e6-8399-4067094ff898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.366292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a375ea-b49a-45e6-8399-4067094ff898 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:44.438942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9475a1a-978a-4277-8080-e3f6b14b3e82 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.479633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.480277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.480567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.480998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.482693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] RBAC: Adding query filter params (interface=public, service_id=c6b81a2b29354a61aa7ef9f4b73e53bb, region_id=RegionOne) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:44.483023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.484770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:44.491120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 395/767] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:10:44.492848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159bbf-7b99-465b-acb8-7888158ea412 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.493091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 373/768] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:10:44 2022] GET /identity/v3/endpoints?service_id=c6b81a2b29354a61aa7ef9f4b73e53bb&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:44.493594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159bbf-7b99-465b-acb8-7888158ea412 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.494038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:44.494294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159bbf-7b99-465b-acb8-7888158ea412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.512736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3d159bbf-7b99-465b-acb8-7888158ea412 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:44.515450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3d159bbf-7b99-465b-acb8-7888158ea412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:44.588083 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 396/769] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:44.589275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159bbf-7b99-465b-acb8-7888158ea412 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:44.634883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd4d9-460e-4d73-95b2-11c5584a70bb None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.673852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.675054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.675606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.676162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.687533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.689339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:44.708313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:44.709280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:44.710186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:44.710186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:44.710186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:44.710186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:44.710409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159bbf-7b99-465b-acb8-7888158ea412 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.712523 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 374/770] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:44.717849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:44.748338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.752111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.752111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.752111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.752111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.752111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:44.763502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 397/771] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:10:44 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:44.763502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:44.922956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507bcd6-47c8-48c9-b8c7-3934f27725ad None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.946787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb236e4-4b8e-4ac6-bdc2-6994fdc4244c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:44.987198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:44.988047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:44.988327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:44.988600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] PATH_INFO: `/v3/services/network` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:44.989266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:44.990682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:45.007159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:45.008334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:45.009194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 375/772] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:44 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:45.014516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.017840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57caad8-9bd6-4dd8-bdc1-751aad59f7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.018529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57caad8-9bd6-4dd8-bdc1-751aad59f7ac None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.018813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57caad8-9bd6-4dd8-bdc1-751aad59f7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.019091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57caad8-9bd6-4dd8-bdc1-751aad59f7ac None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.020133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57caad8-9bd6-4dd8-bdc1-751aad59f7ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:45.020677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57caad8-9bd6-4dd8-bdc1-751aad59f7ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.023054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57caad8-9bd6-4dd8-bdc1-751aad59f7ac None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.037554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 398/773] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.039163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65629cb5-0025-4b7f-b9c3-60c16d0a5fe3 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.039458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65629cb5-0025-4b7f-b9c3-60c16d0a5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.039769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65629cb5-0025-4b7f-b9c3-60c16d0a5fe3 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.041170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 399/774] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:45.044121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65629cb5-0025-4b7f-b9c3-60c16d0a5fe3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.154491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1353c9-2f77-46ac-94ea-42e090ff5c0d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.154729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65629cb5-0025-4b7f-b9c3-60c16d0a5fe3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.191009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.191825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.192105 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.192378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.194250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc1028-0399-49c1-8eee-603c1979b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.195024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc1028-0399-49c1-8eee-603c1979b25c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.195415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc1028-0399-49c1-8eee-603c1979b25c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.195824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc1028-0399-49c1-8eee-603c1979b25c None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.196708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc1028-0399-49c1-8eee-603c1979b25c None admin] RBAC: Adding query filter params (name=network) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:45.197119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc1028-0399-49c1-8eee-603c1979b25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.198611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc1028-0399-49c1-8eee-603c1979b25c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.199731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.201234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.208641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 376/775] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.210176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a498-467c-4f20-bbec-56cd91fa7241 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.210546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a498-467c-4f20-bbec-56cd91fa7241 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.210910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a498-467c-4f20-bbec-56cd91fa7241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:45.216192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:45.217252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:45.218155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 400/776] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:45.218636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.228996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-5432a498-467c-4f20-bbec-56cd91fa7241 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:45.230358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5432a498-467c-4f20-bbec-56cd91fa7241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:45.307564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 377/777] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:45.308460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a498-467c-4f20-bbec-56cd91fa7241 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.350350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ce4f-f8ad-4923-ab32-05d855568869 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.384401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.385072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.385350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.385623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.386319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] RBAC: Adding query filter params (type=network) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:45.386624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.388022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.393017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 401/778] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.393876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.443049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a498-467c-4f20-bbec-56cd91fa7241 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.486198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.487033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.487332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.487974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.489057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:45.489375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.491599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.495760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bec67-3d84-4a0e-8800-d06cc4ba8f4c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.507549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 378/779] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.508754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.534315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.535160 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.535440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.535740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.549218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:45.556951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:45.559120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:45.561746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:45.567639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 402/780] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:45.567639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.636695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdd66c-ea8e-4bf7-ba13-cbba86b3676c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.677955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.678728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.679083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.679445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.680334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] RBAC: Adding query filter params (interface=public, service_id=e9b9c14622db41cba858928706d86b3c, region_id=RegionOne) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:45.680788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.682166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.687351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb29f-44fa-4d6a-956b-9476b45c672b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.692776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 379/781] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/endpoints?service_id=e9b9c14622db41cba858928706d86b3c&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.693830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.729047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.730103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.730684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.731124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.732970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=8c8dbcc6772240dca87cba4dfa85d954) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:45.733440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.735026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.743379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 403/782] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/role_assignments?user.id=8c8dbcc6772240dca87cba4dfa85d954&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.744556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:45.866697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a992a-b36d-46f0-a254-7fddf4f7f3b8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.890306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a305-a1cf-4117-9c7d-479cfe275035 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:45.908838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.909863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.910280 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.910767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.911630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.913194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.920965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 404/783] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.947214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:45.947863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:45.948154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:45.948431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:45.949208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:45.949518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:45.951515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:45.961867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 380/784] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:45.968400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:46.117934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4416-4404-41a4-95a9-90d0d8d6fe49 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:46.152902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:46.154585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:46.155014 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:46.155431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:46.166547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:46.168242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:46.185657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:46.186764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:46.187882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:46.187882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:46.187882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:46.187882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:46.193959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 405/785] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:46.195734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:46.310307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642d03-ae4c-4e81-8ab5-9100c9413608 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:46.349150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac78ad1-9022-4983-99b4-83231ff0d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:46.349829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac78ad1-9022-4983-99b4-83231ff0d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:46.350121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac78ad1-9022-4983-99b4-83231ff0d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:46.350405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac78ad1-9022-4983-99b4-83231ff0d2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:46.351137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac78ad1-9022-4983-99b4-83231ff0d2d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:46.351448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac78ad1-9022-4983-99b4-83231ff0d2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:46.352836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac78ad1-9022-4983-99b4-83231ff0d2d0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:46.370413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 381/786] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:46.376153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:46.454974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef67fc5-533d-4ce9-b375-b866f7cb0df0 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:46.454974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef67fc5-533d-4ce9-b375-b866f7cb0df0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:46.454974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef67fc5-533d-4ce9-b375-b866f7cb0df0 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:46.456639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 382/787] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:10:46.464187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabc37-0416-4478-81fb-ae8080190f90 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:46.464743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabc37-0416-4478-81fb-ae8080190f90 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:46.465222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabc37-0416-4478-81fb-ae8080190f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:46.498003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0ddabc37-0416-4478-81fb-ae8080190f90 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:46.499202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0ddabc37-0416-4478-81fb-ae8080190f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:46.531259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7fd22-4b15-4bbd-9b17-d947cefb72e6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:46.586386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 383/788] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:46.616221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:46.617032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:46.617323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:46.617614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:46.624278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddabc37-0416-4478-81fb-ae8080190f90 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:46.632617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:46.634072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:46.660339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:46.661337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:10:46.662378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:46.671943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 406/789] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:10:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:46.677327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:46.731028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddabc37-0416-4478-81fb-ae8080190f90 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:46.825121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:46.826457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:46.826745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:46.827026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:46.833169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059787a-8bc3-4834-863e-f65a42a3dfaf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:46.856571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:46.870926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:46.871927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:46.872798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 384/790] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:46.878403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:46.884302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:46.884996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:46.885280 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:46.885564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:46.886418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:46.886728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:46.888227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:46.928065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 407/791] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:10:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:46.934256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:47.072730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa44a-e398-497b-a5d3-fa9ccde3a162 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:47.114788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:47.116097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.116386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.116665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.124753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672cd74-4d8b-4162-87bf-0b823bf12a70 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:47.199648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:47.201979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:47.224186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:47.224878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.225173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.225459 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.226221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:47.226536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:47.227941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:47.250660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 385/792] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:47.266676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:47.314633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 408/793] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:10:47.320528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:47.435918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772115e0-3e9a-4045-98b1-3ab9c99475bc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:47.479936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4d51-38d9-4182-ae8e-652197768f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:47.480740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4d51-38d9-4182-ae8e-652197768f1f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.481022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4d51-38d9-4182-ae8e-652197768f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.481299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4d51-38d9-4182-ae8e-652197768f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.501433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb4d51-38d9-4182-ae8e-652197768f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:47.502896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb4d51-38d9-4182-ae8e-652197768f1f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:47.516674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b86ee7-e016-45c3-abbb-8f89113f223b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-18cb4d51-38d9-4182-ae8e-652197768f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:47.530415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:47.532041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 409/794] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4b7a-4849-4673-a5c9-a66da2c2584e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4b7a-4849-4673-a5c9-a66da2c2584e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4b7a-4849-4673-a5c9-a66da2c2584e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.536751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 410/795] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:47.539914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4b7a-4849-4673-a5c9-a66da2c2584e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:47.561232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381645c-9c63-40cc-8d93-e1b5a63f4f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:47.562035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381645c-9c63-40cc-8d93-e1b5a63f4f86 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.562322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381645c-9c63-40cc-8d93-e1b5a63f4f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.563064 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381645c-9c63-40cc-8d93-e1b5a63f4f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.576778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381645c-9c63-40cc-8d93-e1b5a63f4f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:47.579241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381645c-9c63-40cc-8d93-e1b5a63f4f86 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-e381645c-9c63-40cc-8d93-e1b5a63f4f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:47.601774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:47.603951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:47.605981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:47.605981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:47.605981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:47.605981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:47.609089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 386/796] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:47.611076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d044f-ba56-4372-873e-c995995b2ed1 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.611371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d044f-ba56-4372-873e-c995995b2ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.611698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d044f-ba56-4372-873e-c995995b2ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.630208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-604d044f-ba56-4372-873e-c995995b2ed1 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:47.631562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-604d044f-ba56-4372-873e-c995995b2ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:47.666461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4b7a-4849-4673-a5c9-a66da2c2584e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:47.707831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 387/797] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:47.708699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:47.708860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d044f-ba56-4372-873e-c995995b2ed1 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:47.709542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.709895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.710246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.711049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:47.711426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:47.713899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:47.726390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 411/798] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:47.732544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:47.841120 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d044f-ba56-4372-873e-c995995b2ed1 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:47.860785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86fc9-da42-4f24-9fe8-79b78cc8c7f7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:47.877308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:47.877982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.878270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.878633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.879282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:47.879624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:47.881002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:47.898011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 388/799] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:47.898011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:47.903837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:47.904875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:47.905324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:47.906219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:47.916149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:47.917827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:47.937018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:47.938115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:47.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:47.943252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 412/800] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:47.944168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.020869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd615fd3-9567-41d6-9458-4564729c6c12 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.046932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b4df-765f-4bad-87ad-7c6d9f8424c3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.067691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.068515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.068801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.069085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.069753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.071132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:48.087123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:48.088450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:10:48.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:48.093487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 389/801] 10.222.0.55 () {56 vars in 1129 bytes} [Thu May 5 15:10:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:48.093904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.094375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.095618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.096165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.096604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.106633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.109608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:48.130017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:48.131249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:48.132470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:48.140516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 413/802] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:48.140516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.208295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24a9e9-639c-4fba-ae29-a96528fe22f1 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.245736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.246406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.246696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.246995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.248426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:48.248738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.250182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.267822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 390/803] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:48.268645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.278007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fd0aa-ef2a-4024-81a6-98c16524dcfb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.322174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.323604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.324348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.324830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.325971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:48.326786 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.328828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.335137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 414/804] 10.222.0.55 () {56 vars in 1124 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:48.336383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.380930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647d5d6-7689-45c5-b974-5d9a8c6f392f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.417837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.418514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.418801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.419081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.420672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:48.420995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.422413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.435074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce79e0-8241-4def-a994-d6ab894c28aa None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.440296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 391/805] 10.222.0.55 () {56 vars in 1135 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:48.441520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.479876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcde10-fad2-431a-b8ab-ba5d789c7390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.480553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcde10-fad2-431a-b8ab-ba5d789c7390 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.480832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcde10-fad2-431a-b8ab-ba5d789c7390 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.481106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcde10-fad2-431a-b8ab-ba5d789c7390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.482538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcde10-fad2-431a-b8ab-ba5d789c7390 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=abbda90b98bd49569e59c973edba73b4) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:48.482855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcde10-fad2-431a-b8ab-ba5d789c7390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.484653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcde10-fad2-431a-b8ab-ba5d789c7390 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.499497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 415/806] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/role_assignments?user.id=abbda90b98bd49569e59c973edba73b4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:48.499497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8ec99-5bdf-4a71-9a15-7751874c71a4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.499497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8ec99-5bdf-4a71-9a15-7751874c71a4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.499497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8ec99-5bdf-4a71-9a15-7751874c71a4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.499497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 416/807] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:48.499497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8ec99-5bdf-4a71-9a15-7751874c71a4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.579440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bff79-b0a2-4ccc-bbe4-2663ab4d56cc None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.619640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8ec99-5bdf-4a71-9a15-7751874c71a4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.620938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6714c1f-94c4-4a6c-8d6f-dfdc8e688849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.621621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714c1f-94c4-4a6c-8d6f-dfdc8e688849 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.621905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714c1f-94c4-4a6c-8d6f-dfdc8e688849 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.622183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714c1f-94c4-4a6c-8d6f-dfdc8e688849 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.622983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6714c1f-94c4-4a6c-8d6f-dfdc8e688849 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:48.623293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6714c1f-94c4-4a6c-8d6f-dfdc8e688849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.624701 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6714c1f-94c4-4a6c-8d6f-dfdc8e688849 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.630497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 392/808] 10.222.0.55 () {56 vars in 1124 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:48.631969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda15d-bd19-4601-840b-7013650c8b36 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.632258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda15d-bd19-4601-840b-7013650c8b36 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.632536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda15d-bd19-4601-840b-7013650c8b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.651105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-20eda15d-bd19-4601-840b-7013650c8b36 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:48.652416 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-20eda15d-bd19-4601-840b-7013650c8b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:48.663045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.663909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.664193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.664796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.676678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.677773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:48.697250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:48.699131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:48.701372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:48.701372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:48.701372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:48.701372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:48.701372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 417/809] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:48.701372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.734368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 393/810] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:48.735881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf44059-447b-4256-9731-2a29e2057db9 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.736174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf44059-447b-4256-9731-2a29e2057db9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.736508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf44059-447b-4256-9731-2a29e2057db9 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.737927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 394/811] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:48.738545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf44059-447b-4256-9731-2a29e2057db9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:48.812894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd644d7-6054-49cf-b5e7-5b8af9c2d9cc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.845706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf44059-447b-4256-9731-2a29e2057db9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:48.850646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.851649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.852207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.852707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.854158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.856155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.880675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a420c83-485f-43b0-aff1-6f6f07ab5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:48.881364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a420c83-485f-43b0-aff1-6f6f07ab5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.881655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a420c83-485f-43b0-aff1-6f6f07ab5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.881933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a420c83-485f-43b0-aff1-6f6f07ab5aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.882686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a420c83-485f-43b0-aff1-6f6f07ab5aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:48.882998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a420c83-485f-43b0-aff1-6f6f07ab5aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:48.884449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a420c83-485f-43b0-aff1-6f6f07ab5aa5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:48.897086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 395/812] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:48.898391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e0ec-205d-401e-9e41-0b2366b7309a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:48.898721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e0ec-205d-401e-9e41-0b2366b7309a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:48.898996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e0ec-205d-401e-9e41-0b2366b7309a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:48.916239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-81f2e0ec-205d-401e-9e41-0b2366b7309a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:48.917421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-81f2e0ec-205d-401e-9e41-0b2366b7309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:48.967503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 418/813] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:10:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:48.967503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.007986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 396/814] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:49.009011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e0ec-205d-401e-9e41-0b2366b7309a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.072273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65937dab-b469-408c-9720-17731e1f0c33 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.108657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.109381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.109663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.109966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.121152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:49.128998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:49.130073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:49.130949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:49.134780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e0ec-205d-401e-9e41-0b2366b7309a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.135398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 419/815] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:49.136424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.178975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.179843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.180131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.180412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.189298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.190758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:49.209264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:49.210209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:49.211100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:49.213636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 397/816] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:49.214771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.260969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e7bd-5281-4a0f-8bd5-d3f8644de3a8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.296102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.296914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.297198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.297474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.298129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.299520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:49.313950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:49.315215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:49.316321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 420/817] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:49.317292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.350080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5107-30d8-40ea-9a3c-9677719ebec9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.395174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.395796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.396093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.396370 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.397123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:49.397433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.398803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.412758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 398/818] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:49.413905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.442265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c95c5-5b5c-4357-8b60-0979cc09b0b8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.487334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.488612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.489898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.490404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.491412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:49.491945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.493599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.514149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 421/819] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:49.514149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.525569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec00b7f-f706-4fab-a26c-112b4391c154 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.573774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.574323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.574700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.575148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.577292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] RBAC: Adding query filter params (name=network) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:49.577587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.579071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.587742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 399/820] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:49.588720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.634872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7549f-f120-453a-9a85-1f2be88a2a71 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.671271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.672356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.672791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.673227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.683965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.685741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.693227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148a65a-9cde-46a9-9127-3a93e1deec81 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:49.704492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:49.705578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:49.706501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:49.706501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:49.706501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:49.706501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:49.708716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 422/821] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:49.709746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.743164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.745020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.745813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.746352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/21b75b16948240e0b3539152a63429d9/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.749733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=21b75b16948240e0b3539152a63429d9, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.752293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.822145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2b550-2810-430d-8d08-c8a6971fa1df None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:49.847842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 400/822] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:49 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/21b75b16948240e0b3539152a63429d9/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:10:49.849824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.879167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:49.879893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:49.880171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:49.880441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:49.881539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] RBAC: Adding query filter params (type=network) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:49.881873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:49.883834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:49.891112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 423/823] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:49.897506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:49.998280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5b02-0a8f-407f-8cf3-7b2d4e8a4967 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:50.034696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:50.035381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:50.035695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:50.035973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:50.036724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:50.037033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:50.038505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:50.052477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 401/824] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:50.058140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:50.102321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7149878-65f6-43d8-993e-c13d456ccc54 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:50.139770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:50.140421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:50.140748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:50.140993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:50.141742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:50.143092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:50.160463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a2e9-195c-42f1-b160-dcaa14895729 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:50.197997 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:50.198817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:50.199099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:50.199374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:50.207538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:50.208974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:50.225208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:50.226259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:50.227213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 402/825] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:10:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:50.233575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:50.247538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 424/826] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:10:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:50.376547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a930-5b48-416c-afc5-ff1568bf09fa None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:50.437039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:50.437823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:50.438169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:50.438504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:50.439428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:50.439825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:50.441342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:50.470378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 403/827] 10.222.0.55 () {56 vars in 1149 bytes} [Thu May 5 15:10:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:50.476109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:50.592742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1037-34b7-4332-97d6-802d56c9bd83 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:50.628018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:50.628731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:50.629011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:50.629282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:50.641923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:50.643378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:50.662458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:50.663421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:50.664362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:50.664362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:50.664362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:50.664362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:50.664362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 425/828] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:50.669901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:50.792116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126443-0494-4e74-bce0-cac30a72512d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:50.832920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:50.833602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:50.833881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:50.834153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:50.834911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:50.835214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:50.836652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:50.851887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 404/829] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:50.857744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:50.982617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d588-b80c-4a30-b702-ad259ec67b6d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:51.017561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02e69-9dbb-4d7c-9d68-d700ff5f7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:51.018366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02e69-9dbb-4d7c-9d68-d700ff5f7527 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.018651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02e69-9dbb-4d7c-9d68-d700ff5f7527 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.018927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02e69-9dbb-4d7c-9d68-d700ff5f7527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.026330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02e69-9dbb-4d7c-9d68-d700ff5f7527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:51.027827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02e69-9dbb-4d7c-9d68-d700ff5f7527 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d8a02e69-9dbb-4d7c-9d68-d700ff5f7527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:51.045344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:51.046291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:51.047192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 426/830] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:51.052562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:51.140077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e937-8c0d-4b57-997b-e1a197e5ce91 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.140604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e937-8c0d-4b57-997b-e1a197e5ce91 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.140708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e937-8c0d-4b57-997b-e1a197e5ce91 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.142247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 427/831] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:10:51.147807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b1c2-3fd8-46c4-843d-5ed905987458 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.148111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b1c2-3fd8-46c4-843d-5ed905987458 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.148402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b1c2-3fd8-46c4-843d-5ed905987458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.166634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5bd1b1c2-3fd8-46c4-843d-5ed905987458 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:51.167571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f07c7-e2b4-4cc9-bbe6-4ecb05794a92 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:51.167871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5bd1b1c2-3fd8-46c4-843d-5ed905987458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:51.203724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:51.204770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.205264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.205756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.206776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:51.207286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:51.208945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:51.223024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 405/832] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:51.229264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:51.242360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 428/833] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:51.264717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b1c2-3fd8-46c4-843d-5ed905987458 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:51.350998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7eeb-8308-4411-aa18-01d407dbe493 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:51.388596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f1e27-5947-44d5-9968-07af901dccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:51.389579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1e27-5947-44d5-9968-07af901dccdf None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.389807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b1c2-3fd8-46c4-843d-5ed905987458 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:51.389913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1e27-5947-44d5-9968-07af901dccdf None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.390138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1e27-5947-44d5-9968-07af901dccdf None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/8c8dbcc6772240dca87cba4dfa85d954/roles/572a3d7ebad94e73ac07b1b30d647dfa` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.407996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f1e27-5947-44d5-9968-07af901dccdf None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=8c8dbcc6772240dca87cba4dfa85d954, role_id=572a3d7ebad94e73ac07b1b30d647dfa)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:51.409498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f1e27-5947-44d5-9968-07af901dccdf None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:51.436372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:51.437198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.437480 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.437756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.438421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:51.439825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:51.452479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:51.457506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:51.458383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 429/834] 10.222.0.55 () {56 vars in 1132 bytes} [Thu May 5 15:10:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:51.462379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:51.483777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 406/835] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:10:51 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/8c8dbcc6772240dca87cba4dfa85d954/roles/572a3d7ebad94e73ac07b1b30d647dfa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:10:51.596757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14497e-2447-49bc-aff2-9b7ea992144d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:51.617054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f88e-146a-4deb-be8a-047675dc860a None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.617398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f88e-146a-4deb-be8a-047675dc860a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.617624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f88e-146a-4deb-be8a-047675dc860a None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.619241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 407/836] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:51.627175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f764-8ec9-4245-936e-aacd2ee37146 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.628299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f764-8ec9-4245-936e-aacd2ee37146 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.628967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f764-8ec9-4245-936e-aacd2ee37146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.640361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:51.642864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.642864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.642864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.642864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:51.642864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:51.643968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:51.649566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 430/837] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:10:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:51.655608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:51.660745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a991f764-8ec9-4245-936e-aacd2ee37146 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:51.661183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a991f764-8ec9-4245-936e-aacd2ee37146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:51.742359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 408/838] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:51.765274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f764-8ec9-4245-936e-aacd2ee37146 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:51.777283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687230d-ddab-47b2-a4c4-ced3c2080d59 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:51.815966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:51.816636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.816917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.817193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.817897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:51.818202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:51.819717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:51.824872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 431/839] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:10:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:51.898488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f764-8ec9-4245-936e-aacd2ee37146 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:51.938542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:51.939668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:51.940108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:51.940534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:51.941393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:51.942988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:51.956851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:51.958178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:10:51.959228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:51.961926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 409/840] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:10:51.968996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:52.085478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b9879-df86-43bd-a90d-ee5e43260c05 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:52.120843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18f1f-442d-4533-8644-9c84f39cf794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:52.121521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18f1f-442d-4533-8644-9c84f39cf794 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:52.121809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18f1f-442d-4533-8644-9c84f39cf794 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:52.122090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18f1f-442d-4533-8644-9c84f39cf794 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:52.122839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18f1f-442d-4533-8644-9c84f39cf794 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:52.123148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18f1f-442d-4533-8644-9c84f39cf794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:52.124562 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18f1f-442d-4533-8644-9c84f39cf794 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:52.129702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 432/841] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:52.135270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:52.243745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1271-b4ee-4224-a8f2-29d84e2baf61 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:52.283490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2ba6-51ce-43d5-af38-336e13e34410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:52.284806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2ba6-51ce-43d5-af38-336e13e34410 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:52.285335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2ba6-51ce-43d5-af38-336e13e34410 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:52.285825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2ba6-51ce-43d5-af38-336e13e34410 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:52.286787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2ba6-51ce-43d5-af38-336e13e34410 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:52.287336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2ba6-51ce-43d5-af38-336e13e34410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:52.289727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2ba6-51ce-43d5-af38-336e13e34410 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:52.296510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 410/842] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:52.459554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd00f-c39b-4ab7-86ce-56d427ccf022 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:52.460103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd00f-c39b-4ab7-86ce-56d427ccf022 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:52.460103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd00f-c39b-4ab7-86ce-56d427ccf022 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:52.461800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 433/843] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:52.468237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1bd0-0cb9-442c-b1eb-9b91621a782a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:52.468886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1bd0-0cb9-442c-b1eb-9b91621a782a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:52.469373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1bd0-0cb9-442c-b1eb-9b91621a782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:52.489206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-106a1bd0-0cb9-442c-b1eb-9b91621a782a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:52.490743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-106a1bd0-0cb9-442c-b1eb-9b91621a782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:52.566084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 411/844] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:52.589461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd00f-c39b-4ab7-86ce-56d427ccf022 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:52.703348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd00f-c39b-4ab7-86ce-56d427ccf022 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:52.739180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:52.740031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:52.740372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:52.740651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:52.754804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:52.761212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:52.762180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:52.763088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 434/845] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:52.768816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1bd0-0cb9-442c-b1eb-9b91621a782a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:52.876555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1bd0-0cb9-442c-b1eb-9b91621a782a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:52.918502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:52.920354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:52.920607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:52.920891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:52.921703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:52.921957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:52.923646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:52.935378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 412/846] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:52.940829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:53.055390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ba2cc-101c-4076-b36c-786040f6a761 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:53.090203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:53.092383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:53.092677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:53.092934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:53.103606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:53.105055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:53.125041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:53.126789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:53.128586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:53.128586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:53.128586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:53.128586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:53.128586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 435/847] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:53.136642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:53.283214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba1d1-9a1f-4a6e-a523-f2712b923883 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:53.340721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:53.342845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:53.343694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:53.344463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:53.346095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:53.346907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:53.349881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:53.372657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 413/848] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:53.383567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:53.486330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90894d6-a9df-460f-bb9e-05e3a2425f57 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:53.521833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:53.522691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:53.522982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:53.523261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:53.531327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:53.532856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:53.549702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:53.550766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:53.551757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 436/849] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:10:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:53.556769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:53.660529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd3147-3c33-45f4-8383-bfedf4739ca5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:53.696809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:53.697885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:53.698381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:53.698986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:53.700087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:53.700752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:53.702444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:53.721961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 414/850] 10.222.0.55 () {56 vars in 1135 bytes} [Thu May 5 15:10:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:53.731507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:53.840334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b08ec-a28b-4737-a251-00d56628997d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:53.876904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a549e-27dd-498f-b21e-9641b0ae0b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:53.877977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a549e-27dd-498f-b21e-9641b0ae0b86 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:53.878496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a549e-27dd-498f-b21e-9641b0ae0b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:53.878976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a549e-27dd-498f-b21e-9641b0ae0b86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:53.953203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a549e-27dd-498f-b21e-9641b0ae0b86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:53.955144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a549e-27dd-498f-b21e-9641b0ae0b86 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:54.060545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 437/851] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:10:54.071583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.081958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141dab1-b247-4a43-8efb-c2ec29cff4b8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.082271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141dab1-b247-4a43-8efb-c2ec29cff4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.082530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141dab1-b247-4a43-8efb-c2ec29cff4b8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.084600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 438/852] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:10:54.089920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058507-8015-4041-92ee-bbc7c83b283c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.090239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058507-8015-4041-92ee-bbc7c83b283c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.090524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058507-8015-4041-92ee-bbc7c83b283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.110807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fc058507-8015-4041-92ee-bbc7c83b283c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:54.112047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fc058507-8015-4041-92ee-bbc7c83b283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:54.184587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78764d-e639-4a7b-8d1e-e9f06993df41 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.192004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 439/853] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:54.193433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93324b64-b6e3-4408-9c15-dc58896ec57c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.193724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93324b64-b6e3-4408-9c15-dc58896ec57c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.194013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93324b64-b6e3-4408-9c15-dc58896ec57c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.196240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 440/854] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:54.200778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928dcdb-9578-4549-9724-b742fb58ff62 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.201066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928dcdb-9578-4549-9724-b742fb58ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.201345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928dcdb-9578-4549-9724-b742fb58ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.220059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3928dcdb-9578-4549-9724-b742fb58ff62 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:54.221188 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3928dcdb-9578-4549-9724-b742fb58ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:54.232178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:54.232986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.233268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.233542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.243757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:54.245206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:54.263789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:54.264725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:54.270412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:54.270412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:54.270412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:54.270412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:54.270412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 415/855] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:54.270412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.298556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 441/856] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:10:54.299884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928dcdb-9578-4549-9724-b742fb58ff62 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.381542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a897-3ccb-4641-97bd-94fd5a870563 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.398702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928dcdb-9578-4549-9724-b742fb58ff62 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.415634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:54.416718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.417006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.417287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.428861 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:54.433548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:54.434219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.434502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.435348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.436096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:54.436405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:54.437216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:54.438181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:10:54.440156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:54.440791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:54.440872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 416/857] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:54.440872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.453930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 442/858] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:54.454769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.559092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e89d0-480f-49f6-9a0e-a73202d9b791 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.569697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeaef5-19e3-40ca-ae59-a94c4c0f2c8c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.600890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:54.601561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.601849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.602144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.602849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:54.603296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:54.604000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.604243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:54.604354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.604559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.605309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:54.605622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:54.607386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:54.615488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 443/859] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:54.616487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.695895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 417/860] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:10:54 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:54.697382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.766740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15efd3-9129-4c5b-b6de-c49cfb2f5ee3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.810860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225123ee-f60c-4206-8b6e-ea755a60fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:54.811768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225123ee-f60c-4206-8b6e-ea755a60fb71 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.812088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225123ee-f60c-4206-8b6e-ea755a60fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.812387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225123ee-f60c-4206-8b6e-ea755a60fb71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.820080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225123ee-f60c-4206-8b6e-ea755a60fb71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:54.821562 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225123ee-f60c-4206-8b6e-ea755a60fb71 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:54.826461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9e15-3e73-498a-aa1b-3eae15a66910 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-225123ee-f60c-4206-8b6e-ea755a60fb71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:54.837352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:54.838335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 444/861] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749398a-c7b8-4ad2-b31f-8491ee351357 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.844295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749398a-c7b8-4ad2-b31f-8491ee351357 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.844897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749398a-c7b8-4ad2-b31f-8491ee351357 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.844897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 445/862] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:54.846775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749398a-c7b8-4ad2-b31f-8491ee351357 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:54.868485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537cb4-af5e-4df4-8f51-c31bec43f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:54.869307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537cb4-af5e-4df4-8f51-c31bec43f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.869591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537cb4-af5e-4df4-8f51-c31bec43f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.869872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537cb4-af5e-4df4-8f51-c31bec43f4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.881177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537cb4-af5e-4df4-8f51-c31bec43f4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:54.882637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537cb4-af5e-4df4-8f51-c31bec43f4f7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-dd537cb4-af5e-4df4-8f51-c31bec43f4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:54.902198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:54.903140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:54.904739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:54.904739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:54.904739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:54.904739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:54.904739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 418/863] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:54.907509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6c586-38aa-44d9-ad6a-61dbe4f24b3f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:54.907509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6c586-38aa-44d9-ad6a-61dbe4f24b3f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:54.907509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6c586-38aa-44d9-ad6a-61dbe4f24b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:54.923577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ebc6c586-38aa-44d9-ad6a-61dbe4f24b3f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:54.924846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ebc6c586-38aa-44d9-ad6a-61dbe4f24b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:54.959081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749398a-c7b8-4ad2-b31f-8491ee351357 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:54.990843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 419/864] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:54 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:54.991739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6c586-38aa-44d9-ad6a-61dbe4f24b3f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:55.001821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:55.003021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:55.003517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:55.004230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:55.005190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:55.005814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:55.008068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:55.024598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 446/865] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:55.025803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:55.094191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6c586-38aa-44d9-ad6a-61dbe4f24b3f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:55.131360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:55.132063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:55.132343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:55.132615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:55.133334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:55.133636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:55.134989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:55.137529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3ab7-2a19-43c2-8f25-8b30e3cf55e6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:55.150790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 420/866] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:55.150790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:55.177505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:55.178446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:55.178911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:55.179386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:55.180314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:55.181856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:55.244494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895d98-dd66-487f-b667-575293725f27 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:55.275942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 447/867] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:10:55 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:10:55.276966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:55.284061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:55.284748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:55.285033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:55.285310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:55.286547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=21b75b16948240e0b3539152a63429d9) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:55.286547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:55.288074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:55.299970 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 421/868] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:55 2022] GET /identity/v3/role_assignments?user.id=21b75b16948240e0b3539152a63429d9&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:55.409822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf89dc-683d-4a4e-ac63-50aa20a53bb5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:55.450977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:55.452323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:55.452832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:55.453324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:55.462607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:55.464514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:10:55.482897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:55.483964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:55.484942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 448/869] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:10:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:55.490359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:55.593694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5917-f578-4f09-857e-cd5e46d02290 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:55.628130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:55.628808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:55.629092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:55.629369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:55.630212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:55.630522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:55.631987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:55.652908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 422/870] 10.222.0.55 () {56 vars in 1149 bytes} [Thu May 5 15:10:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:55.665727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:55.765837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b840-1fd1-4eec-b605-f0d1e63ff41d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:55.799949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:55.800612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:55.800897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:55.801178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:55.870296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:55.871818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:55.978826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 449/871] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:10:55 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:10:55.984319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:56.085929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f835636-ba97-4e55-8101-a5de02506a2b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:56.121156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:56.121959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:56.122783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:56.123057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:56.133509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:56.134967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:56.153367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:56.154322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:56.155244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:56.155244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:56.155244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:56.155244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:56.155244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 423/872] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:56.160382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:56.262263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6750f-03df-4f6b-bbdd-5760366c97e2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:56.297660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:56.298337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:56.298622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:56.298900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:56.299643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:56.299956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:56.301331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:56.313216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 450/873] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:56.320571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:56.425487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5558-568b-499c-9e57-f135b1b27118 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:56.460099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:56.460903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:56.461183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:56.461454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:56.468838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:56.470301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:10:56.485379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:56.487589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:56.489739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 424/874] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:56.492706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:56.602831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc0d0d-fbbd-4ca1-8a4e-82438d158d62 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:56.637350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7473a9-02d2-406e-8e25-6068da7572c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:56.638305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7473a9-02d2-406e-8e25-6068da7572c9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:56.638592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7473a9-02d2-406e-8e25-6068da7572c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:56.638857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7473a9-02d2-406e-8e25-6068da7572c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:56.639670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7473a9-02d2-406e-8e25-6068da7572c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:56.639982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7473a9-02d2-406e-8e25-6068da7572c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:56.641412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7473a9-02d2-406e-8e25-6068da7572c9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:56.654468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 451/875] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:56.664568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:56.768062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eff5b-5d25-484a-bc39-fea003dd47e7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:56.802195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a753f39-a2f7-4aac-8781-cd9ffc96eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:56.802853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a753f39-a2f7-4aac-8781-cd9ffc96eeda None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:56.803140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a753f39-a2f7-4aac-8781-cd9ffc96eeda None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:56.803418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a753f39-a2f7-4aac-8781-cd9ffc96eeda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:56.804282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a753f39-a2f7-4aac-8781-cd9ffc96eeda None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=8c8dbcc6772240dca87cba4dfa85d954) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:56.804591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a753f39-a2f7-4aac-8781-cd9ffc96eeda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:56.806070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a753f39-a2f7-4aac-8781-cd9ffc96eeda None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:56.812544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 425/876] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:10:56 2022] GET /identity/v3/role_assignments?user.id=8c8dbcc6772240dca87cba4dfa85d954&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:57.030436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3cc69-4ece-44b5-9fa2-abfcfc3c7e8d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.030925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3cc69-4ece-44b5-9fa2-abfcfc3c7e8d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.030925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3cc69-4ece-44b5-9fa2-abfcfc3c7e8d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.032298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 452/877] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:57.037999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e021c-84dc-4e13-a38a-78579f4ff949 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.038292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e021c-84dc-4e13-a38a-78579f4ff949 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.038580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e021c-84dc-4e13-a38a-78579f4ff949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.056026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-445e021c-84dc-4e13-a38a-78579f4ff949 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:57.057280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-445e021c-84dc-4e13-a38a-78579f4ff949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:57.128233 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 426/878] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:57.151179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3cc69-4ece-44b5-9fa2-abfcfc3c7e8d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:57.257536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3cc69-4ece-44b5-9fa2-abfcfc3c7e8d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:57.292553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:57.293299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.293588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.293869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.295049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:57.296453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:57.308945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:57.310883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:57.312326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 453/879] 10.222.0.55 () {56 vars in 1132 bytes} [Thu May 5 15:10:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:57.316682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e021c-84dc-4e13-a38a-78579f4ff949 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:57.416476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e021c-84dc-4e13-a38a-78579f4ff949 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:57.453350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:57.454030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.454316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.454598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.455308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:57.455646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:57.457013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:57.461951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 427/880] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:10:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:57.467531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:57.579669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474a5e-ba5c-4a6a-a195-c92cfb10c537 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:57.613638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd77a-f80f-4cf5-a2ed-04528a4e5ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:57.614316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd77a-f80f-4cf5-a2ed-04528a4e5ede None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.614603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd77a-f80f-4cf5-a2ed-04528a4e5ede None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.614885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd77a-f80f-4cf5-a2ed-04528a4e5ede None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.615632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd77a-f80f-4cf5-a2ed-04528a4e5ede None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:57.615948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd77a-f80f-4cf5-a2ed-04528a4e5ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:57.617342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd77a-f80f-4cf5-a2ed-04528a4e5ede None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:57.623484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 454/881] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:10:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:57.628917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:57.726094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae899fb-81e7-430f-8663-addc2494762f None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.726445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae899fb-81e7-430f-8663-addc2494762f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.726645 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae899fb-81e7-430f-8663-addc2494762f None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.728180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 455/882] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:10:57.729130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd232a-856b-4a97-b3b9-c307e9574c70 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.729411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd232a-856b-4a97-b3b9-c307e9574c70 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.729744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd232a-856b-4a97-b3b9-c307e9574c70 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.731053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 456/883] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:57.733893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35003d-2150-42a4-bae8-428976b94340 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.734177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35003d-2150-42a4-bae8-428976b94340 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.734840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35003d-2150-42a4-bae8-428976b94340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.741659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed691f4c-2477-4bc0-8c40-0563e815f8ae None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:57.757161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3f35003d-2150-42a4-bae8-428976b94340 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:57.758352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3f35003d-2150-42a4-bae8-428976b94340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:57.777975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe437a-1b53-4eed-9079-633bfc900a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:57.778654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe437a-1b53-4eed-9079-633bfc900a22 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.778998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe437a-1b53-4eed-9079-633bfc900a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.779287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe437a-1b53-4eed-9079-633bfc900a22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.780144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe437a-1b53-4eed-9079-633bfc900a22 None admin] RBAC: Adding query filter params (interface=public, service_id=daf7d0096e9a4cf480a92bf46e950a91, region_id=RegionOne) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:57.780455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe437a-1b53-4eed-9079-633bfc900a22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:57.781815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe437a-1b53-4eed-9079-633bfc900a22 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:57.791392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 428/884] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:10:57 2022] GET /identity/v3/endpoints?service_id=daf7d0096e9a4cf480a92bf46e950a91&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:57.791392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1e27-a517-4c19-a18d-7f15719d84ab None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.791392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1e27-a517-4c19-a18d-7f15719d84ab None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.791392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1e27-a517-4c19-a18d-7f15719d84ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.804930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e64f1e27-a517-4c19-a18d-7f15719d84ab None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:57.806157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e64f1e27-a517-4c19-a18d-7f15719d84ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:57.832251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 457/885] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:57.840391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35003d-2150-42a4-bae8-428976b94340 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:57.883522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 429/886] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:10:57.883522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f1e27-a517-4c19-a18d-7f15719d84ab None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:57.953008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35003d-2150-42a4-bae8-428976b94340 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:57.978915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f1e27-a517-4c19-a18d-7f15719d84ab None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:57.987017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:57.987743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:57.988033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:57.988315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:57.988997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:57.990368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.003716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 458/887] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:10:57 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:10:58.003716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:58.035857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.037077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.037423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.037765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.038718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.044856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:58.061656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:58.062917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:10:58.063967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:58.067392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 430/888] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:58.073624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:58.126124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a99824-a2ad-4774-a113-db3d605444c4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:58.164779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.165978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.166476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.166925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.167823 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.169483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:58.182630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:58.184041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:10:58.185195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:10:58.185944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecef75e-9c0a-44c3-9ca8-2bf3ec649a7f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:58.193607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 459/889] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:10:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:58.194779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:58.226905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.227631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.227927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.228204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.228920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:58.229230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.230604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.237050 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 431/890] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:58.241569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:58.306222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dd1ec-9fd8-480c-b0c0-4cde24da6328 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:58.339434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.340170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.340449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.341290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.341995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:58.342298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.343033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d80b4f-e2c8-4916-8b57-efcbbb1bc1f4 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:58.343682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.354142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 460/891] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:10:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:58.355045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:58.378215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.378810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.379131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.379850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.380570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:58.380880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.382727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.391551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 432/892] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:10:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:58.395958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:58.475104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85ed6-9185-48f7-ba53-2df40e74e4fe None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:58.508503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b36e8-5c84-4b09-9ed0-dd5bc033c2c4 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:58.510987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.511992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.512107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.512457 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.513529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:58.513902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.515339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.520322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 461/893] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:10:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:58.552842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07084cf-1680-4ef9-8ad0-d7598df2b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.553796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07084cf-1680-4ef9-8ad0-d7598df2b59a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.554234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07084cf-1680-4ef9-8ad0-d7598df2b59a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.554660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07084cf-1680-4ef9-8ad0-d7598df2b59a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.555661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07084cf-1680-4ef9-8ad0-d7598df2b59a None admin] RBAC: Adding query filter params (interface=public, service_id=e68e825bd6004f6e8ff44468b743ad6b, region_id=RegionOne) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:58.556161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07084cf-1680-4ef9-8ad0-d7598df2b59a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.557719 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07084cf-1680-4ef9-8ad0-d7598df2b59a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.565016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 433/894] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:10:58 2022] GET /identity/v3/endpoints?service_id=e68e825bd6004f6e8ff44468b743ad6b&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:10:58.575775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:58.681411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236156d4-b675-48ce-8388-47ac8ea6ed44 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:58.718966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec2d9-93d3-4c98-b691-41fdf0e7af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:58.719667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec2d9-93d3-4c98-b691-41fdf0e7af79 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:58.719951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec2d9-93d3-4c98-b691-41fdf0e7af79 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:58.720228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec2d9-93d3-4c98-b691-41fdf0e7af79 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:58.720909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec2d9-93d3-4c98-b691-41fdf0e7af79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:58.722271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec2d9-93d3-4c98-b691-41fdf0e7af79 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:58.728455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 462/895] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:10:58 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:10:59.251839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62812662-8522-429e-b257-8050c92a1e18 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:59.252362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62812662-8522-429e-b257-8050c92a1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:59.252474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62812662-8522-429e-b257-8050c92a1e18 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:59.254016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 434/896] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:10:59.259414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5897f-8aa8-4c6e-94bb-6ca62b2da56b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:59.259847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5897f-8aa8-4c6e-94bb-6ca62b2da56b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:59.260020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5897f-8aa8-4c6e-94bb-6ca62b2da56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:59.277407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8fe5897f-8aa8-4c6e-94bb-6ca62b2da56b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:10:59.278631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8fe5897f-8aa8-4c6e-94bb-6ca62b2da56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:10:59.346546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 463/897] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:10:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:10:59.370201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62812662-8522-429e-b257-8050c92a1e18 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:59.473520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62812662-8522-429e-b257-8050c92a1e18 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:59.508722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:59.509872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:59.510361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:59.510836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:59.522425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:10:59.531582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:59.532513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:10:59.533358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:59.536172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 435/898] 10.222.0.55 () {56 vars in 1120 bytes} [Thu May 5 15:10:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:59.541682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5897f-8aa8-4c6e-94bb-6ca62b2da56b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:59.644038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5897f-8aa8-4c6e-94bb-6ca62b2da56b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:59.681684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:59.682395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:59.682682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:59.682960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:59.683770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:10:59.684084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:59.686107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:59.696327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 464/899] 10.222.0.55 () {56 vars in 1115 bytes} [Thu May 5 15:10:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:10:59.704595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:10:59.817571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a805e-d343-4e9e-b17f-80dd0c3372b6 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:10:59.852012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:10:59.852817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:10:59.853105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:10:59.853386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:10:59.865186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:10:59.866635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:10:59.884616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:10:59.885540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:10:59.886430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:10:59.886430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:10:59.886430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:10:59.886430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:10:59.886430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 436/900] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:10:59.892604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.005399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea21f56-2d5c-4b2a-8e4d-cd0a240b70d3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.039863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:00.040547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.040833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.041116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.041840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:00.042151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:00.043631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:00.057108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 465/901] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:00.064565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.164968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aa2ed-55e9-4fe8-9147-0c37e379dc7e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.204246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27b791-527a-4a50-8399-75a449682859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:00.205509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b791-527a-4a50-8399-75a449682859 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.206108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b791-527a-4a50-8399-75a449682859 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.206604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b791-527a-4a50-8399-75a449682859 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.216047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27b791-527a-4a50-8399-75a449682859 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:00.218009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27b791-527a-4a50-8399-75a449682859 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-bc27b791-527a-4a50-8399-75a449682859 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:11:00.234660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:00.235737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:11:00.236710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:00.239392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 437/902] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:11:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:00.245250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.348922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e150d-5e91-40a8-aa1e-5a45396f76c4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.391017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858b1f4-ba78-4e13-8567-080a00db11bc None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.392043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858b1f4-ba78-4e13-8567-080a00db11bc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.392375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:00.392764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858b1f4-ba78-4e13-8567-080a00db11bc None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.393055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.393340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.393614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.394456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:00.394764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:00.399326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:00.399676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 438/903] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:00.401598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd5db-5644-4d04-b875-94ec42e70cae None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.402089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd5db-5644-4d04-b875-94ec42e70cae None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.402563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd5db-5644-4d04-b875-94ec42e70cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.415054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 466/904] 10.222.0.55 () {56 vars in 1149 bytes} [Thu May 5 15:11:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:00.420432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9a9bd5db-5644-4d04-b875-94ec42e70cae None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:00.421601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9a9bd5db-5644-4d04-b875-94ec42e70cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:00.424447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.503490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 439/905] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:00.518032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bd5db-5644-4d04-b875-94ec42e70cae None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.550363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d6acc-ebb3-404e-8865-7bfc8c241855 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.594581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:00.595720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.596011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.596295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.620890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bd5db-5644-4d04-b875-94ec42e70cae None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.666849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:00.667838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.668252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.668559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.669272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:00.671413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:00.683990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:00.686297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:00.687443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:00.688358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:11:00.689194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:00.693737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 440/906] 10.222.0.55 () {56 vars in 1132 bytes} [Thu May 5 15:11:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:00.695548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.812112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183acf-4ec0-4704-a5f6-2cdb10c416b0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.819563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 467/907] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:00.823604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.848909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129c7bb-c9a5-469f-9668-2fdd4e9f3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:00.849574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c7bb-c9a5-469f-9668-2fdd4e9f3d05 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.849854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c7bb-c9a5-469f-9668-2fdd4e9f3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.850129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c7bb-c9a5-469f-9668-2fdd4e9f3d05 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.850831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129c7bb-c9a5-469f-9668-2fdd4e9f3d05 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:00.851139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129c7bb-c9a5-469f-9668-2fdd4e9f3d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:00.852526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129c7bb-c9a5-469f-9668-2fdd4e9f3d05 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:00.858138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 441/908] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:11:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:00.859415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c8e0-6545-41f2-a376-e5fa0146224c None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.859729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c8e0-6545-41f2-a376-e5fa0146224c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.860000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c8e0-6545-41f2-a376-e5fa0146224c None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.861357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 442/909] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:00.864377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689c8e0-6545-41f2-a376-e5fa0146224c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:00.929667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760203d3-e66f-46d3-98e4-76486c177d9d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.965282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd056887-8e56-4c87-af66-3534aa495a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:00.966108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056887-8e56-4c87-af66-3534aa495a87 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:00.966391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056887-8e56-4c87-af66-3534aa495a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:00.966670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056887-8e56-4c87-af66-3534aa495a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:00.969676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689c8e0-6545-41f2-a376-e5fa0146224c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:00.976908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd056887-8e56-4c87-af66-3534aa495a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:00.978357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd056887-8e56-4c87-af66-3534aa495a87 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-cd056887-8e56-4c87-af66-3534aa495a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:00.996362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:00.998092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:00.999190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:00.999190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:00.999190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:00.999190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:01.002792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 468/910] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:01.004130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096f14-c120-4a84-8275-a8bae7767590 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.004422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096f14-c120-4a84-8275-a8bae7767590 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.004708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096f14-c120-4a84-8275-a8bae7767590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.006377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.007058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.007334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.007642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.008351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:01.008663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.010029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.019544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 443/911] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:11:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:01.019544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.026354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5f096f14-c120-4a84-8275-a8bae7767590 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:01.027561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5f096f14-c120-4a84-8275-a8bae7767590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:01.099498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 469/912] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:01.099498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f096f14-c120-4a84-8275-a8bae7767590 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.119370 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992912-5d4c-4c16-9e06-47f0d28abb20 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.152236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.152974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.153318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.153597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.154306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:01.154611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.155994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.166911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 444/913] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:01.167692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.203775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f096f14-c120-4a84-8275-a8bae7767590 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.235515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47156f6c-d423-4e22-8b62-0a5b1d8ac128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.236169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47156f6c-d423-4e22-8b62-0a5b1d8ac128 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.236452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47156f6c-d423-4e22-8b62-0a5b1d8ac128 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.236727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47156f6c-d423-4e22-8b62-0a5b1d8ac128 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.237453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47156f6c-d423-4e22-8b62-0a5b1d8ac128 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.238801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47156f6c-d423-4e22-8b62-0a5b1d8ac128 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.261029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465941a-b92a-4af4-b529-9449f4c59089 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.292516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d3dc5-ff60-4c26-ac35-8abe1834c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.293171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3dc5-ff60-4c26-ac35-8abe1834c038 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.293453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3dc5-ff60-4c26-ac35-8abe1834c038 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.294292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3dc5-ff60-4c26-ac35-8abe1834c038 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.294990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d3dc5-ff60-4c26-ac35-8abe1834c038 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.296426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d3dc5-ff60-4c26-ac35-8abe1834c038 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.314541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 470/914] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:11:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:01.315926 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dea7a-35e6-4b26-ae4c-7ff73a7bc9ae None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.316213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dea7a-35e6-4b26-ae4c-7ff73a7bc9ae None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.316492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dea7a-35e6-4b26-ae4c-7ff73a7bc9ae None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.317706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 471/915] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:01.318414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dea7a-35e6-4b26-ae4c-7ff73a7bc9ae None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.372936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 445/916] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:11:01 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:01.374845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1e24-b6da-4df0-b01f-53013308a544 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.375517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1e24-b6da-4df0-b01f-53013308a544 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.376077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1e24-b6da-4df0-b01f-53013308a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.402908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-5dae1e24-b6da-4df0-b01f-53013308a544 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:01.405759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5dae1e24-b6da-4df0-b01f-53013308a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:01.452473 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dea7a-35e6-4b26-ae4c-7ff73a7bc9ae None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.487452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 446/917] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:01.491495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.492317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.492598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.492870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.502059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.502447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.510103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1e24-b6da-4df0-b01f-53013308a544 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:11:01.517744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:01.518690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:01.519877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 472/918] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:01.525695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.641088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1e24-b6da-4df0-b01f-53013308a544 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.649950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808aa4-8b92-483e-8ea5-9555a651188b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.680903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.681774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.682128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.682411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.683071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.684547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.690311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.690974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.691259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.691565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.692353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:01.692662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.694133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:01.696659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:01.697607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:11:01.698423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:01.702876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 447/919] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:11:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:01.705038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.711580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 473/920] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:01.718023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.822467 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7874bd-f470-4174-8dcf-94a5f836db8a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.828959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6ec49-86df-4716-94db-f5c145ad0963 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:01.856894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.857879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.858367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.858867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.859819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:01.860330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.861879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.862652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:01.863354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:01.863667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:01.863937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:01.864755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] RBAC: Adding query filter params (role.id=e9285b302841419aab0d26cdb9b15b46, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=8c8dbcc6772240dca87cba4dfa85d954) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:01.865051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:01.866459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:01.873067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 448/922] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:11:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:01.875276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:01.879935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 474/922] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:01 2022] GET /identity/v3/role_assignments?user.id=8c8dbcc6772240dca87cba4dfa85d954&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=e9285b302841419aab0d26cdb9b15b46 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:01.984699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65c12-72cb-441c-8a71-815cb488508a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:02.021935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a59f-a8b7-4bdb-b6ee-146bdd675583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:02.022984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a59f-a8b7-4bdb-b6ee-146bdd675583 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:02.023514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a59f-a8b7-4bdb-b6ee-146bdd675583 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:02.023998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a59f-a8b7-4bdb-b6ee-146bdd675583 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:02.024927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a59f-a8b7-4bdb-b6ee-146bdd675583 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:02.025465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a59f-a8b7-4bdb-b6ee-146bdd675583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:02.027088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a59f-a8b7-4bdb-b6ee-146bdd675583 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:02.037786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 449/923] 10.222.0.55 () {56 vars in 1114 bytes} [Thu May 5 15:11:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:02.040630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:02.145384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f2b7-8fd8-4939-82a1-db9800aa1213 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:02.178514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c79296-9262-4391-ae18-1a5aaf2b2712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:02.179611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79296-9262-4391-ae18-1a5aaf2b2712 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:02.180099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79296-9262-4391-ae18-1a5aaf2b2712 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:02.180570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79296-9262-4391-ae18-1a5aaf2b2712 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:02.181506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c79296-9262-4391-ae18-1a5aaf2b2712 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:02.183074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c79296-9262-4391-ae18-1a5aaf2b2712 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:02.301361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 475/924] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:11:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:03.702931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1c68-f376-46ee-88c7-e6902432caa2 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:03.703454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1c68-f376-46ee-88c7-e6902432caa2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:03.703592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1c68-f376-46ee-88c7-e6902432caa2 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:03.705240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 450/925] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:03.710733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ca89-3465-4094-ab7b-25b2f62f7b3b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:03.711206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ca89-3465-4094-ab7b-25b2f62f7b3b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:03.711287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ca89-3465-4094-ab7b-25b2f62f7b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:03.734007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fee9ca89-3465-4094-ab7b-25b2f62f7b3b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:03.735258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fee9ca89-3465-4094-ab7b-25b2f62f7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:03.758591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17b2a-3ce4-425d-9461-69b135ece74e None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:03.758879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17b2a-3ce4-425d-9461-69b135ece74e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:03.759400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17b2a-3ce4-425d-9461-69b135ece74e None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:03.761230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 451/926] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:03.766941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7dd41-58b4-417c-9830-a956ad872388 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:03.767495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7dd41-58b4-417c-9830-a956ad872388 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:03.767986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7dd41-58b4-417c-9830-a956ad872388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:03.785075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9cf7dd41-58b4-417c-9830-a956ad872388 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:03.786607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9cf7dd41-58b4-417c-9830-a956ad872388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:03.832262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 476/927] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:03.855052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ca89-3465-4094-ab7b-25b2f62f7b3b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:03.865444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 452/928] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:03.889081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7dd41-58b4-417c-9830-a956ad872388 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:03.967047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ca89-3465-4094-ab7b-25b2f62f7b3b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.004612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.005740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.006258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.006723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.007627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.009068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.022042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7dd41-58b4-417c-9830-a956ad872388 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:04.025727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:04.026950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:04.028608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:04.036017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 477/929] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:04.038265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.064555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.065949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.066342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.066720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.067764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.069410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:04.084882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:04.086178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:04.087276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:04.089412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 453/930] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:11:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:04.095243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.163244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf932-7709-4321-a50a-7e9badf3cc65 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.197023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decc53-875c-4f64-9232-532ecdedc96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.197702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decc53-875c-4f64-9232-532ecdedc96d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.197988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decc53-875c-4f64-9232-532ecdedc96d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.198274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decc53-875c-4f64-9232-532ecdedc96d None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.198984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decc53-875c-4f64-9232-532ecdedc96d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:04.199295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decc53-875c-4f64-9232-532ecdedc96d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.200764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decc53-875c-4f64-9232-532ecdedc96d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.210036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 478/931] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:04.210260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896d487-7ef6-466d-8404-94d294167170 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.210361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7b50-c405-47fc-96e7-29ab7d5ae07d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.210361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7b50-c405-47fc-96e7-29ab7d5ae07d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.210361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7b50-c405-47fc-96e7-29ab7d5ae07d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.210361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 479/932] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:04.212302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7b50-c405-47fc-96e7-29ab7d5ae07d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.249557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dea60-0f61-41ea-8575-fa76aa2d7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.250145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dea60-0f61-41ea-8575-fa76aa2d7f6d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.250426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dea60-0f61-41ea-8575-fa76aa2d7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.250712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dea60-0f61-41ea-8575-fa76aa2d7f6d None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.251415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dea60-0f61-41ea-8575-fa76aa2d7f6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:04.251751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dea60-0f61-41ea-8575-fa76aa2d7f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.253108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dea60-0f61-41ea-8575-fa76aa2d7f6d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.257783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 454/933] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:04.259066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22995-0298-4682-b9d4-fdb31e8e7105 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.259357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22995-0298-4682-b9d4-fdb31e8e7105 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.259662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22995-0298-4682-b9d4-fdb31e8e7105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.275759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0ef22995-0298-4682-b9d4-fdb31e8e7105 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:04.276926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0ef22995-0298-4682-b9d4-fdb31e8e7105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:04.326107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7b50-c405-47fc-96e7-29ab7d5ae07d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.347702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 455/934] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:04.347702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef22995-0298-4682-b9d4-fdb31e8e7105 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.369479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.370431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.370856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.371296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.372231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:04.372686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.374214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.379319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 480/935] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:04.380211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.467809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef22995-0298-4682-b9d4-fdb31e8e7105 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.507847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.508509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.508805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.509088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.509833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:04.510140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.511587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.517306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df4265-e3bd-499a-b69b-981f12a6bb91 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.522343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 456/936] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:04.523334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.568700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.570363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.570848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.571675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.585498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:04.593847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:04.594856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:04.595762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:04.601133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 481/937] 10.222.0.55 () {56 vars in 1120 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:04.602074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.658111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3421f-9606-4989-ae95-ceb6cec68898 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.696874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bd27a-3cba-4bf8-982d-c3ca87ecf7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.697538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd27a-3cba-4bf8-982d-c3ca87ecf7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.697818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd27a-3cba-4bf8-982d-c3ca87ecf7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.698095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd27a-3cba-4bf8-982d-c3ca87ecf7a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.698944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bd27a-3cba-4bf8-982d-c3ca87ecf7a1 None admin] RBAC: Adding query filter params (interface=public, service_id=890d2bdf937f41fd97b412cc02931829, region_id=RegionOne) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:04.699262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bd27a-3cba-4bf8-982d-c3ca87ecf7a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.700825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bd27a-3cba-4bf8-982d-c3ca87ecf7a1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.710309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 457/938] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/endpoints?service_id=890d2bdf937f41fd97b412cc02931829&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:04.710309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cef7d-60bb-4285-b7d1-f2b728585386 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.710309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cef7d-60bb-4285-b7d1-f2b728585386 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.710309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cef7d-60bb-4285-b7d1-f2b728585386 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.710309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 458/939] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:04.712493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cef7d-60bb-4285-b7d1-f2b728585386 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.725466 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95151c86-19d3-41af-8b21-913adf7c39c6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.766655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6c95a-4f2b-4bd4-821a-027042dfc6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.767270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6c95a-4f2b-4bd4-821a-027042dfc6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.767594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6c95a-4f2b-4bd4-821a-027042dfc6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.767868 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6c95a-4f2b-4bd4-821a-027042dfc6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.768623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6c95a-4f2b-4bd4-821a-027042dfc6f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:04.768934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6c95a-4f2b-4bd4-821a-027042dfc6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.770306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6c95a-4f2b-4bd4-821a-027042dfc6f2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.783241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 482/940] 10.222.0.55 () {56 vars in 1115 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:04.783241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731ef2-662f-4f1b-a533-1d76b10676b3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.783241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731ef2-662f-4f1b-a533-1d76b10676b3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.783241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731ef2-662f-4f1b-a533-1d76b10676b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.799137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-02731ef2-662f-4f1b-a533-1d76b10676b3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:04.800431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-02731ef2-662f-4f1b-a533-1d76b10676b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:04.820489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cef7d-60bb-4285-b7d1-f2b728585386 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:04.854074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:04.854741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:04.855021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:04.855305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:04.856587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:04.857942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:04.863889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 459/941] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:11:04.868545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.879187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 483/942] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:04.903713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02731ef2-662f-4f1b-a533-1d76b10676b3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:04.998705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727888db-7891-4bb3-9d0b-0b4384c562c2 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.045052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02731ef2-662f-4f1b-a533-1d76b10676b3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.050147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.051314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.051839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.052318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.066830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.068474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.082310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.082982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.083270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.083583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.084307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.085736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:05.086797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:05.087787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:05.088686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:05.088686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:05.088686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:05.088686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:05.088919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING keystone.server.flask.common [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 05 15:11:05.088994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 460/943] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:05.093834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:05.140273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.sql.core [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:11:05.140273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 15:11:05.140273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [parameters: {'id': '1e2da6acc99646ccaf20f6121d9f42f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 15:11:05.140273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e2da6acc99646ccaf20f6121d9f42f8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e2da6acc99646ccaf20f6121d9f42f8. May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:11:05.150593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 05 15:11:05.155743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return project_ref.to_dict() May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application yield resource May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise self.value May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application session.commit() May 05 15:11:05.156695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.flush() May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application compat.raise_( May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:11:05.157597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:11:05.158529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:11:05.159393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [parameters: {'id': '1e2da6acc99646ccaf20f6121d9f42f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.161227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:05.163069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.Conflict( May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e2da6acc99646ccaf20f6121d9f42f8. May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 484/944] 10.222.0.55 () {60 vars in 1140 bytes} [Thu May 5 15:11:04 2022] POST /identity/v3/projects => generated 262 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:05.165281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:05.213026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d22ea-3cc9-4b89-97fb-5058b1740d2e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.250662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.251768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.252261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.252736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.253711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:05.254292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.255898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.273122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92cfae-d938-4240-b524-e414dfd47a79 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.273527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 461/945] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:05.274700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:05.307015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.307870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.308150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.308422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.319517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.319707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:11:05.337782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:05.338739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.339669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 485/946] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:05.351495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:05.398027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bfa81-fd6d-4dcc-8865-974c75622bdd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.433946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.435395 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.435709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.436008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.443766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.445200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.450503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7627b-56f3-427c-aa2e-ee44bce9a81f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:11:05.459624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:05.460605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:05.461552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 462/947] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:11:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:05.467933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:05.492022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.493070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.493564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.494045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.495509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:05.496366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.499086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.525489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 486/948] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:11:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:05.585605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef108c-d848-4d75-a112-e9f4fc783327 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.625724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.626421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.626710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.626991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.627896 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:05.628212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.629786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.650288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 463/949] 10.222.0.55 () {56 vars in 1149 bytes} [Thu May 5 15:11:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:05.656221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:05.777248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba5c3b-0027-4fcc-b22c-095e790bc91f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.812102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.812905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.813182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.813454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.824005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:05.825522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:05.844818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:05.845951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:05.847058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:05.847058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:05.847058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:05.847058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:05.847058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 487/950] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:05.853058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:05.954364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045fd06-ecb7-48dc-a686-4cb59f8c609b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:05.994939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:05.996042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:05.996571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:05.997058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:05.997986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:05.998507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:06.000097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:06.012877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 464/951] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:06.019250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:06.133710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c674a8-7344-454e-b383-3b6b924b1e12 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:06.168751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:06.169880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:06.170388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:06.170858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:06.177680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:06.179334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:11:06.192947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:06.193883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:06.194768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:06.197221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 488/952] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:06.204106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:06.307045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0967c3-a9b3-46fa-bc0b-f84d79e9533b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:06.345158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef444d-63c1-43c3-a7f1-47c389f3f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:06.346205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef444d-63c1-43c3-a7f1-47c389f3f219 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:06.346689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef444d-63c1-43c3-a7f1-47c389f3f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:06.347236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef444d-63c1-43c3-a7f1-47c389f3f219 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:06.348300 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef444d-63c1-43c3-a7f1-47c389f3f219 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:06.348843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef444d-63c1-43c3-a7f1-47c389f3f219 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:06.350650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef444d-63c1-43c3-a7f1-47c389f3f219 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:06.364612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 465/953] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:06.370840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:06.476424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454870d-888d-4150-9d5a-0fa1d9a4c88c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:06.511420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06503bfb-3f2c-41f3-911e-34779e9edd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:06.512519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06503bfb-3f2c-41f3-911e-34779e9edd91 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:06.513075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06503bfb-3f2c-41f3-911e-34779e9edd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:06.513356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06503bfb-3f2c-41f3-911e-34779e9edd91 None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/8c8dbcc6772240dca87cba4dfa85d954/roles/e9285b302841419aab0d26cdb9b15b46` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:06.515771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06503bfb-3f2c-41f3-911e-34779e9edd91 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=8c8dbcc6772240dca87cba4dfa85d954, role_id=e9285b302841419aab0d26cdb9b15b46)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:06.517205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06503bfb-3f2c-41f3-911e-34779e9edd91 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:06.630306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 489/954] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:11:06 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/8c8dbcc6772240dca87cba4dfa85d954/roles/e9285b302841419aab0d26cdb9b15b46 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:11:06.770627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443522-6fe1-4ca4-831f-99a4b3a7b3cd None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:06.770944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443522-6fe1-4ca4-831f-99a4b3a7b3cd None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:06.771201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443522-6fe1-4ca4-831f-99a4b3a7b3cd None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:06.772972 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 466/955] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:06.778951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970004f9-bf48-4b3f-ae9b-484e42fa56c3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:06.779519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970004f9-bf48-4b3f-ae9b-484e42fa56c3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:06.779602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970004f9-bf48-4b3f-ae9b-484e42fa56c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:06.798678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-970004f9-bf48-4b3f-ae9b-484e42fa56c3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:06.800479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-970004f9-bf48-4b3f-ae9b-484e42fa56c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:06.873019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 490/956] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:06.897211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443522-6fe1-4ca4-831f-99a4b3a7b3cd None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:07.001503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443522-6fe1-4ca4-831f-99a4b3a7b3cd None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:07.037142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc8c0-737f-4ae0-b7de-05b3faf0d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:07.037748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc8c0-737f-4ae0-b7de-05b3faf0d2ce None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.038038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc8c0-737f-4ae0-b7de-05b3faf0d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.038329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc8c0-737f-4ae0-b7de-05b3faf0d2ce None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.039068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc8c0-737f-4ae0-b7de-05b3faf0d2ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:07.040582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc8c0-737f-4ae0-b7de-05b3faf0d2ce None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:07.119544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 467/957] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:11:06 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:07.250969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a0337-1fc1-4848-83d4-57bc34877fed None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.251332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a0337-1fc1-4848-83d4-57bc34877fed None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.251574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a0337-1fc1-4848-83d4-57bc34877fed None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.253276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 491/958] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:07.259167 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814a66-b803-4f61-9ad5-d44bce57508d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.259458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814a66-b803-4f61-9ad5-d44bce57508d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.259767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814a66-b803-4f61-9ad5-d44bce57508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.279512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ff814a66-b803-4f61-9ad5-d44bce57508d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:07.280733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ff814a66-b803-4f61-9ad5-d44bce57508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:07.359583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 468/959] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:07.382823 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a0337-1fc1-4848-83d4-57bc34877fed None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:07.500537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a0337-1fc1-4848-83d4-57bc34877fed None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:07.536761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:07.537570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.537851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.538124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.538843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:07.540257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:07.553131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:07.554186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:07.555019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 492/960] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:11:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:07.562956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814a66-b803-4f61-9ad5-d44bce57508d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:07.666613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814a66-b803-4f61-9ad5-d44bce57508d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:07.702285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:07.702957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.703248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.703629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.704342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:07.704656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:07.706015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:07.711292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 469/961] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:07.717554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:07.828325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954030e-5ca8-4a06-991c-553ad6c69d80 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:07.865360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aa0e7-d606-40c1-b130-006c27c8f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:07.866055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa0e7-d606-40c1-b130-006c27c8f165 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.866344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa0e7-d606-40c1-b130-006c27c8f165 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.866629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa0e7-d606-40c1-b130-006c27c8f165 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.867360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aa0e7-d606-40c1-b130-006c27c8f165 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:07.867712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aa0e7-d606-40c1-b130-006c27c8f165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:07.869140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aa0e7-d606-40c1-b130-006c27c8f165 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:07.876079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 493/962] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:07.881781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:07.970573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c15e9e-625f-407e-9485-1014a32a6d04 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.970876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c15e9e-625f-407e-9485-1014a32a6d04 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.971064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c15e9e-625f-407e-9485-1014a32a6d04 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.972691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 494/963] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:07.978426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea249-f98e-4264-88d1-720d6761af99 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:07.978721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea249-f98e-4264-88d1-720d6761af99 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:07.979003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea249-f98e-4264-88d1-720d6761af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:07.986991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0336e-4b62-4d5f-949e-17891a388eab None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:08.006233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-501ea249-f98e-4264-88d1-720d6761af99 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:08.007461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-501ea249-f98e-4264-88d1-720d6761af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:08.025543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:08.026747 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:08.027235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:08.028403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:08.029625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:08.031163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:08.082502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 495/964] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:08.107051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ea249-f98e-4264-88d1-720d6761af99 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:08.131617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 470/965] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:11:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:08.227164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ea249-f98e-4264-88d1-720d6761af99 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:08.272295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:08.273060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:08.273343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:08.273620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:08.274329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:08.275814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:08.314795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.sql.core [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:11:08.314795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 15:11:08.314795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [parameters: {'user_id': '8ad959295f214f22ab0dd9b3f3423389', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 15:11:08.314795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() May 05 15:11:08.322619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:11:08.323765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application yield resource May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise self.value May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application session.commit() May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:11:08.324828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.flush() May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application compat.raise_( May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:11:08.326093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = connection._execute_20( May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:11:08.327692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:11:08.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [parameters: {'user_id': '8ad959295f214f22ab0dd9b3f3423389', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:08.331082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 05 15:11:08.334366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 05 15:11:08.337554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 05 15:11:08.337554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 05 15:11:08.337554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:11:08.337554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:11:08.337554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 15:11:08.337554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:08.337554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 496/966] 10.222.0.55 () {60 vars in 1131 bytes} [Thu May 5 15:11:08 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:08.337986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:08.440973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92fc8-2b0b-4aa4-8b6f-20c952859312 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:08.475021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4952105-ae84-4cc8-9c1b-43ce0ba1926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:08.476317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4952105-ae84-4cc8-9c1b-43ce0ba1926d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:08.476831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4952105-ae84-4cc8-9c1b-43ce0ba1926d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:08.477385 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4952105-ae84-4cc8-9c1b-43ce0ba1926d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:08.486028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4952105-ae84-4cc8-9c1b-43ce0ba1926d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:08.487768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4952105-ae84-4cc8-9c1b-43ce0ba1926d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-c4952105-ae84-4cc8-9c1b-43ce0ba1926d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:11:08.503173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:08.504210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:11:08.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:08.511569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 471/967] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:11:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:08.514621 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:08.617643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692b18a-24fd-47bd-b9f9-7f6169dee839 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:08.652325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1943a-6f89-47cb-965a-61079a3f5378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:08.653392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1943a-6f89-47cb-965a-61079a3f5378 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:08.653850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1943a-6f89-47cb-965a-61079a3f5378 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:08.654296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1943a-6f89-47cb-965a-61079a3f5378 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:08.655265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1943a-6f89-47cb-965a-61079a3f5378 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:08.659702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1943a-6f89-47cb-965a-61079a3f5378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:08.659702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1943a-6f89-47cb-965a-61079a3f5378 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:08.697430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 497/968] 10.222.0.55 () {56 vars in 1101 bytes} [Thu May 5 15:11:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:09.047254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304900fb-f440-4c3d-97d8-60f8986543c1 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.047845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304900fb-f440-4c3d-97d8-60f8986543c1 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.047845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304900fb-f440-4c3d-97d8-60f8986543c1 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.049172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 472/969] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:09.054661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f5c2-ca58-4cca-966f-81e99b529a7a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.055116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f5c2-ca58-4cca-966f-81e99b529a7a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.055303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f5c2-ca58-4cca-966f-81e99b529a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.072746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-75b5f5c2-ca58-4cca-966f-81e99b529a7a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:09.074256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-75b5f5c2-ca58-4cca-966f-81e99b529a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:09.140631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 498/970] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:09.164571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304900fb-f440-4c3d-97d8-60f8986543c1 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.263945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304900fb-f440-4c3d-97d8-60f8986543c1 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:09.298810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:09.299610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.299898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.300177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.312311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:09.320764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:09.321867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:09.322797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:09.327874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 473/971] 10.222.0.55 () {56 vars in 1120 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:09.328728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5f5c2-ca58-4cca-966f-81e99b529a7a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.426401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5f5c2-ca58-4cca-966f-81e99b529a7a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:09.458553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582a5c4-4e44-46a2-a9a1-b93500331eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:09.459223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a5c4-4e44-46a2-a9a1-b93500331eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.459530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a5c4-4e44-46a2-a9a1-b93500331eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.459811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a5c4-4e44-46a2-a9a1-b93500331eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.460550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582a5c4-4e44-46a2-a9a1-b93500331eb9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:09.460857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582a5c4-4e44-46a2-a9a1-b93500331eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:09.462211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582a5c4-4e44-46a2-a9a1-b93500331eb9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:09.470344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 499/972] 10.222.0.55 () {56 vars in 1115 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:09.475685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.489328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ef76-0577-4f91-9c55-5c8d6f41ade1 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.489850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ef76-0577-4f91-9c55-5c8d6f41ade1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.489963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ef76-0577-4f91-9c55-5c8d6f41ade1 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.491241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 500/973] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:09.496245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0876b-96e3-458c-a5c4-0458e66b96bb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.497063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0876b-96e3-458c-a5c4-0458e66b96bb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.497339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0876b-96e3-458c-a5c4-0458e66b96bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.514793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-34d0876b-96e3-458c-a5c4-0458e66b96bb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:09.515996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-34d0876b-96e3-458c-a5c4-0458e66b96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:09.574588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dfab2-a570-4cd8-ba96-38ce1956c6f5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:09.581829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 501/974] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:09.604185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0876b-96e3-458c-a5c4-0458e66b96bb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.607390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:09.608209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.608496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.608771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.619409 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:09.620872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:09.638759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:09.639771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:09.645494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:09.645494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:09.645494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:09.645494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:09.645494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 474/975] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:09.645796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.704119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0876b-96e3-458c-a5c4-0458e66b96bb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:09.741909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:09.742883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.743256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.743451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.744123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:09.745485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:09.751277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52eba0-15dc-4ac0-93a9-da960e425463 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:09.759630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:09.760902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:09.764725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 502/976] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:09.767807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.790949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:09.791805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.792093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.792697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.793706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:09.794019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:09.796238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:09.812081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 475/977] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:09.817419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.872696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a1757-2e42-40fb-9ff7-eaac86eff3f6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:09.905776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:09.906558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.906916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.907197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.907939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:09.908251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:09.909652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:09.919751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 503/978] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:09.919944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da472113-a9ee-4ff1-b335-0c6363f9f718 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:09.920656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:09.950908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:09.951953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:09.952183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:09.952463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:09.960173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:09.961628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:11:09.976716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:09.977925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:09.978893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 476/979] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:09.984175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.029056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868d8bb-00a8-4975-911d-6bfa7561b3d8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.063332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.064130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.064364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.064712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.065335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:10.065640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.067229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.071989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 504/980] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:10.077544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.085683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e357e4a-98f4-4bb7-9bb4-f135c721dc6a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.120199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.121134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.122158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.122443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.123338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:10.123649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.125089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.142367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 477/981] 10.222.0.55 () {56 vars in 1149 bytes} [Thu May 5 15:11:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:10.147940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.186976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcab85-ba34-47d7-bbb3-21631a3e296e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.220787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.221445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.221728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.222003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.222785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] RBAC: Adding query filter params (interface=public, service_id=60c75adbb73b4fe5a1d1c82bfdc6e195, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:10.223095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.224504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.238043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 505/982] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/endpoints?service_id=60c75adbb73b4fe5a1d1c82bfdc6e195&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:10.239866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.244361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb708251-8ca6-4e55-ad74-e9db9e9a09c7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.283583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.284396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.284678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.284951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.342136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03168be-247e-4cc5-a902-ac8bce858e3e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.358453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.359937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.383246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae2a23-7c1b-4f7e-8fd9-633ada0ad81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.384032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae2a23-7c1b-4f7e-8fd9-633ada0ad81a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.384649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae2a23-7c1b-4f7e-8fd9-633ada0ad81a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.384939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae2a23-7c1b-4f7e-8fd9-633ada0ad81a None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.385770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae2a23-7c1b-4f7e-8fd9-633ada0ad81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.387987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae2a23-7c1b-4f7e-8fd9-633ada0ad81a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.394506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 506/983] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:11:10.460219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949227-a429-4cd4-b9e0-d007941c687e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.460498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949227-a429-4cd4-b9e0-d007941c687e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.460793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949227-a429-4cd4-b9e0-d007941c687e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.462380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 507/984] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:10.472286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 478/985] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:11:10.472498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bb6c2-843c-4554-b867-10f31e3d199c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.472498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bb6c2-843c-4554-b867-10f31e3d199c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.472498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bb6c2-843c-4554-b867-10f31e3d199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.473592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.487799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a88bb6c2-843c-4554-b867-10f31e3d199c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:10.489017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a88bb6c2-843c-4554-b867-10f31e3d199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:10.561391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 508/986] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:10.579696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268032-4d78-4039-b246-9650f916a8cc None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.585015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bb6c2-843c-4554-b867-10f31e3d199c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.620911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.622284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.622565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.622841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.632686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.634189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:10.651644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:10.657602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:10.658516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:10.658516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:10.658516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:10.658516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:10.658516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 479/987] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:10.658516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.688734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bb6c2-843c-4554-b867-10f31e3d199c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.723140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.723972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.724256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.724527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.725177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.726531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:10.740402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:10.741452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:10.742378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 509/988] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:10.748309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.767010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc2a82-e072-44ae-bbfe-df2b13ca2ba0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.800764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.801730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.802219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.802687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.803647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:10.804149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.805694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.817797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 480/989] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:10.823176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.852682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0686fe0-b24b-411a-90d0-c085c69aeea0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.885257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.886172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.886593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.887849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.888699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:10.889180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.890542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.900316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 510/990] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:10.901095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:10.917803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332958a-f246-47bd-8d7e-7e04f9f704e6 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:10.950330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:10.951113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:10.951390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:10.951690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:10.958228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:10.959695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:11:10.974971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:10.975961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:10.977088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 481/991] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:10.981792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:11.005030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e548-0388-49ba-a240-e4fdc538b3b8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:11.037468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:11.038125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:11.038405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:11.038675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:11.039362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:11.039690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:11.041041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:11.045946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 511/992] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:11.051390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:11.081656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229764-9653-4e74-97a1-ad117d77565d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:11.114853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:11.115676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:11.115799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:11.116075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:11.116851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:11.117156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:11.118576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:11.135629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 482/993] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:11:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:11.136459 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:11.150769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54944339-d61a-4bac-92ee-9ff55b06932c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:11.183329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:11.184555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:11.184836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:11.185109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:11.185896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] RBAC: Adding query filter params (interface=admin, service_id=890d2bdf937f41fd97b412cc02931829, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:11.186203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:11.187657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:11.192856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 512/994] 10.222.0.55 () {56 vars in 1249 bytes} [Thu May 5 15:11:11 2022] GET /identity/v3/endpoints?service_id=890d2bdf937f41fd97b412cc02931829&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:11.197993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:11.236750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970db5-ff76-4808-9327-7fa0fe7b588d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:11.271406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2d0dd-3211-49aa-bbca-913b387439c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:11.272090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2d0dd-3211-49aa-bbca-913b387439c5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:11.272371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2d0dd-3211-49aa-bbca-913b387439c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:11.272647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2d0dd-3211-49aa-bbca-913b387439c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:11.273471 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2d0dd-3211-49aa-bbca-913b387439c5 None admin] RBAC: Adding query filter params (role.id=e9285b302841419aab0d26cdb9b15b46, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=8c8dbcc6772240dca87cba4dfa85d954) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:11.273778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2d0dd-3211-49aa-bbca-913b387439c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:11.275194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2d0dd-3211-49aa-bbca-913b387439c5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:11.282481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 483/995] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:11 2022] GET /identity/v3/role_assignments?user.id=8c8dbcc6772240dca87cba4dfa85d954&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=e9285b302841419aab0d26cdb9b15b46 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:11.300784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5da9e-e4d0-4d68-bd40-e2c6b2aecd1b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:11.337937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834285-56ec-445f-9b93-43d0fc26f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:11.338626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834285-56ec-445f-9b93-43d0fc26f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:11.338909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834285-56ec-445f-9b93-43d0fc26f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:11.339181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834285-56ec-445f-9b93-43d0fc26f9c0 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:11.339913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834285-56ec-445f-9b93-43d0fc26f9c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:11.341927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834285-56ec-445f-9b93-43d0fc26f9c0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:11.349643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 513/996] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:11:11 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:11:12.681665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b3d7-9c2e-498a-852b-e3ad96f02ed0 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:12.682283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b3d7-9c2e-498a-852b-e3ad96f02ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:12.682283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b3d7-9c2e-498a-852b-e3ad96f02ed0 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:12.683640 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 484/997] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:12.689572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030fd1-1aa1-461c-ad4c-c8070c68c8e6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:12.689975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030fd1-1aa1-461c-ad4c-c8070c68c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:12.690129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030fd1-1aa1-461c-ad4c-c8070c68c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:12.707202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0f030fd1-1aa1-461c-ad4c-c8070c68c8e6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:12.708428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0f030fd1-1aa1-461c-ad4c-c8070c68c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:12.775330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 514/998] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:12.797562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b3d7-9c2e-498a-852b-e3ad96f02ed0 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:12.897643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b3d7-9c2e-498a-852b-e3ad96f02ed0 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:12.930554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:12.931355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:12.931724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:12.931950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:12.932596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:12.933951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:12.945414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:12.946455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:11:12.947353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:12.952098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 485/999] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:12.953084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030fd1-1aa1-461c-ad4c-c8070c68c8e6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:13.052620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030fd1-1aa1-461c-ad4c-c8070c68c8e6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:13.086950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:13.087659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.087945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.088220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.088921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:13.089227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:13.091162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:13.100610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 515/1000] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:11:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:13.102179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:13.198731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83876859-6669-489f-a1c1-6f758b143002 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:13.232877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b819d-613e-474c-b6a0-8e1060adc490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:13.233557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b819d-613e-474c-b6a0-8e1060adc490 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.233843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b819d-613e-474c-b6a0-8e1060adc490 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.234124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b819d-613e-474c-b6a0-8e1060adc490 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.234836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b819d-613e-474c-b6a0-8e1060adc490 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:13.235145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b819d-613e-474c-b6a0-8e1060adc490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:13.236543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b819d-613e-474c-b6a0-8e1060adc490 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:13.246139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 486/1001] 10.222.0.55 () {56 vars in 1112 bytes} [Thu May 5 15:11:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:13.247949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:13.349419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84bdd1-a3e2-40c9-bf1c-7985c556bdc3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:13.382822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d52b9-e256-4c17-a113-ad8d9213a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:13.383531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d52b9-e256-4c17-a113-ad8d9213a42c None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.383821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d52b9-e256-4c17-a113-ad8d9213a42c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.384100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d52b9-e256-4c17-a113-ad8d9213a42c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.384881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d52b9-e256-4c17-a113-ad8d9213a42c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:13.386305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d52b9-e256-4c17-a113-ad8d9213a42c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:13.494691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 516/1002] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:11:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:13.585324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b000c-da85-4dff-a6f5-ccb31c71887f None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.585658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b000c-da85-4dff-a6f5-ccb31c71887f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.585887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b000c-da85-4dff-a6f5-ccb31c71887f None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.587428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 487/1003] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:13.592924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b190135-5400-4aa4-8ef9-3633b897f8d8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.593219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b190135-5400-4aa4-8ef9-3633b897f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.593489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b190135-5400-4aa4-8ef9-3633b897f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.612065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4b190135-5400-4aa4-8ef9-3633b897f8d8 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:13.613269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4b190135-5400-4aa4-8ef9-3633b897f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:13.652598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1b78e-15f5-4295-9fcd-bc373c9d56ab None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.652923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1b78e-15f5-4295-9fcd-bc373c9d56ab None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.653151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1b78e-15f5-4295-9fcd-bc373c9d56ab None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.654731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 488/1004] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:13.660253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24c63e-0c67-46ef-aa28-ddc0ea8d721d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.660586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24c63e-0c67-46ef-aa28-ddc0ea8d721d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.660810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24c63e-0c67-46ef-aa28-ddc0ea8d721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.679530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-5d24c63e-0c67-46ef-aa28-ddc0ea8d721d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:13.680174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5d24c63e-0c67-46ef-aa28-ddc0ea8d721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:13.700438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 517/1005] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:13 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:13.722771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b190135-5400-4aa4-8ef9-3633b897f8d8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:13.753582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 489/1006] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:13 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:13.791522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24c63e-0c67-46ef-aa28-ddc0ea8d721d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:13.840712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b190135-5400-4aa4-8ef9-3633b897f8d8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:13.886704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:13.888206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.888494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.888778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] PATH_INFO: `/v3/services/image` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.889504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:13.891158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:13.903897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:13.908873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:13.909726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 518/1007] 10.222.0.55 () {56 vars in 1105 bytes} [Thu May 5 15:11:13 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:13.911320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:13.926344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24c63e-0c67-46ef-aa28-ddc0ea8d721d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:13.966780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:13.967622 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:13.967906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:13.968180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:13.968841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:13.970211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:13.982508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:13.983785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:11:13.984845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:13.988573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 490/1008] 10.222.0.55 () {56 vars in 1126 bytes} [Thu May 5 15:11:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:13.989457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:14.019648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10056c7e-deaf-4eab-86ee-d6862c673d1c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:14.055924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:14.056604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:14.056886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:14.057162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:14.057872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] RBAC: Adding query filter params (name=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:14.058180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:14.060220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:14.065744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 519/1009] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:14.071681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:14.096555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3523-f908-4d47-91cf-666a8ec8768e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:14.129414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:14.130071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:14.130372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:14.130631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:14.131326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:14.131671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:14.133010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:14.138600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 491/1010] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:14.143992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:14.169982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6d70-63dc-488f-bf96-7f86e6e07f7b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:14.203265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:14.203965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:14.204250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:14.204678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:14.205382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] RBAC: Adding query filter params (type=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:14.205692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:14.207052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:14.211445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 520/1011] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:14.244208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff047aa-d784-46b9-a2bb-133ed45d5e65 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:14.279807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341c715-f1fd-486d-9f3b-0c2917a488fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:14.280411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c715-f1fd-486d-9f3b-0c2917a488fd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:14.280692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c715-f1fd-486d-9f3b-0c2917a488fd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:14.280964 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c715-f1fd-486d-9f3b-0c2917a488fd None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:14.281681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c715-f1fd-486d-9f3b-0c2917a488fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:14.281986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c715-f1fd-486d-9f3b-0c2917a488fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:14.283354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c715-f1fd-486d-9f3b-0c2917a488fd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:14.294214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 492/1012] 10.222.0.55 () {56 vars in 1122 bytes} [Thu May 5 15:11:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:14.295418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:14.398193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36abd-4e6f-42f9-9b0c-7b429eefb71f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:14.433164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d59ad-d4cc-49e2-8872-f44dfbf08dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:14.433891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d59ad-d4cc-49e2-8872-f44dfbf08dc6 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:14.434226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d59ad-d4cc-49e2-8872-f44dfbf08dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:14.434505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d59ad-d4cc-49e2-8872-f44dfbf08dc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:14.435247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d59ad-d4cc-49e2-8872-f44dfbf08dc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:14.436641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d59ad-d4cc-49e2-8872-f44dfbf08dc6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:14.548769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 521/1013] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:11:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:15.911292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246c62-eaf7-4d7f-8e42-3496b5e1bd13 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:15.911835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246c62-eaf7-4d7f-8e42-3496b5e1bd13 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:15.912029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246c62-eaf7-4d7f-8e42-3496b5e1bd13 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:15.913386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 493/1014] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:15.918566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32531c7-5371-4b30-bfb1-4b87cc5c91c6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:15.918966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32531c7-5371-4b30-bfb1-4b87cc5c91c6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:15.919129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32531c7-5371-4b30-bfb1-4b87cc5c91c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:15.935956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c32531c7-5371-4b30-bfb1-4b87cc5c91c6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:15.937152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c32531c7-5371-4b30-bfb1-4b87cc5c91c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:16.010588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 522/1015] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:16.033962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246c62-eaf7-4d7f-8e42-3496b5e1bd13 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.139758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246c62-eaf7-4d7f-8e42-3496b5e1bd13 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:16.172502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:16.173321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.173608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.173887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.184172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:16.192224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:16.193147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:16.194000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:16.195803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 494/1016] 10.222.0.55 () {56 vars in 1120 bytes} [Thu May 5 15:11:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:16.200025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32531c7-5371-4b30-bfb1-4b87cc5c91c6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.304490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32531c7-5371-4b30-bfb1-4b87cc5c91c6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:16.339483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1a84-0147-4468-a6ea-e5689abc98d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:16.340713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1a84-0147-4468-a6ea-e5689abc98d8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.341001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1a84-0147-4468-a6ea-e5689abc98d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.341279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1a84-0147-4468-a6ea-e5689abc98d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.342026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1a84-0147-4468-a6ea-e5689abc98d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:16.342336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1a84-0147-4468-a6ea-e5689abc98d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:16.343727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1a84-0147-4468-a6ea-e5689abc98d8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:16.357270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 523/1017] 10.222.0.55 () {56 vars in 1115 bytes} [Thu May 5 15:11:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:16.358573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.455163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2cd53-b875-437b-8f3d-1ff1ec3ab3c8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:16.467271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7de1b-16a3-462d-8376-f2fc391a0435 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.467678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7de1b-16a3-462d-8376-f2fc391a0435 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.468034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7de1b-16a3-462d-8376-f2fc391a0435 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.469488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 524/1018] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:16.474336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491583-a8c3-4912-9c04-e516eb1a8858 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.474626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491583-a8c3-4912-9c04-e516eb1a8858 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.474901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491583-a8c3-4912-9c04-e516eb1a8858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.491429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-96491583-a8c3-4912-9c04-e516eb1a8858 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:16.492642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-96491583-a8c3-4912-9c04-e516eb1a8858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:16.492970 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:16.493772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.494057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.494337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.505090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:16.506545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:16.524043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:16.524945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:16.525843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:16.525843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:16.525843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:16.525843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:16.525843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 495/1019] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:16.531522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.565401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 525/1020] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:16.588332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96491583-a8c3-4912-9c04-e516eb1a8858 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.638221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8361d3-2907-4dd1-976d-4b903e77e805 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:16.673286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:16.673954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.674245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.674525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.675252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:16.675643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:16.676960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:16.689596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 496/1021] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:16.694856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.700509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96491583-a8c3-4912-9c04-e516eb1a8858 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:16.734081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf984-de61-4d89-bbd4-8fdfdb05b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:16.734758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf984-de61-4d89-bbd4-8fdfdb05b47f None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.735044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf984-de61-4d89-bbd4-8fdfdb05b47f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.735319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf984-de61-4d89-bbd4-8fdfdb05b47f None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.738856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaf984-de61-4d89-bbd4-8fdfdb05b47f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:16.738856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaf984-de61-4d89-bbd4-8fdfdb05b47f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:16.802556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaac1a2-39b6-4910-b3f8-065e442fbd72 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:16.835658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:16.836380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.836667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.836944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.837521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 526/1022] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:11:16 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:11:16.839508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b09b-66ce-4426-bf24-5c2f7929e89b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.839508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b09b-66ce-4426-bf24-5c2f7929e89b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.839713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b09b-66ce-4426-bf24-5c2f7929e89b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.840875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 527/1023] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:16.845255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:16.846638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a482c9-564b-45ae-bf1b-f109429f58fe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:16.846742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:16.846941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a482c9-564b-45ae-bf1b-f109429f58fe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:16.847222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a482c9-564b-45ae-bf1b-f109429f58fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:11:16.862926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:16.863988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:16.864931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 497/1024] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:11:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:16.866313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-06a482c9-564b-45ae-bf1b-f109429f58fe None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:16.867639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-06a482c9-564b-45ae-bf1b-f109429f58fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:16.870259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.948578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 528/1025] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:16.973527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a482c9-564b-45ae-bf1b-f109429f58fe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:16.977143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351502-4880-4539-8bc5-8c1f6850e694 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:17.014115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:17.014805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:17.015091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:17.015369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:17.016251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:17.016557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:17.018060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:17.036878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 498/1026] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:11:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:17.043041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:17.080921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a482c9-564b-45ae-bf1b-f109429f58fe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:17.113364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:17.114076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:17.114350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:17.114624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:17.115832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:17.117259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:17.119032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 529/1027] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:17.125032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:17.144424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808595-918e-4e81-a234-5380e9e8ef48 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:17.177517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:17.178174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:17.178457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:17.178737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:17.223344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db38c9-b0a6-47dc-b14e-eacfcb92357b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:17.249379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:17.250851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:17.260184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:17.260846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:17.261125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:17.261398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:17.263019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:17.264467 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:17.349128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 499/1028] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:17.354726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:17.375519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 530/1029] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:11:17 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:11:17.459690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4bc5-3830-461a-b7d4-7c15c6d32dd4 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:17.502521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:17.503342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:17.503658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:17.503938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:17.515414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:17.516913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:17.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:17.536325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:17.542111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:17.542111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:17.542111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:17.542111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:17.542111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 500/1030] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:17.544565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:17.647448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cecbc6-41c6-42e5-abc1-4e4565e38f3a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:17.681156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:17.681831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:17.682228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:17.682464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:17.683188 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:17.684268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:17.685821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:17.698096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 531/1031] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:17.703957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:17.802809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b26c72-5a56-4e0f-a31d-734dd07151a1 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:17.836083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:17.836879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:17.837163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:17.837440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:17.844290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:17.845725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:11:17.859240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:17.860342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:17.861258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:17.863537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 501/1032] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:17.866410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:17.968169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a202-8d54-4407-b1cf-809de93d7a61 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:18.000888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfb411-cad8-4506-8bcd-d6e1667e4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:18.001573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfb411-cad8-4506-8bcd-d6e1667e4486 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:18.001860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfb411-cad8-4506-8bcd-d6e1667e4486 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:18.002138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfb411-cad8-4506-8bcd-d6e1667e4486 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:18.002947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfb411-cad8-4506-8bcd-d6e1667e4486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:18.003262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfb411-cad8-4506-8bcd-d6e1667e4486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:18.004806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfb411-cad8-4506-8bcd-d6e1667e4486 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:18.023165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 532/1033] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:18.024354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:18.128429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0683-2748-4410-9bda-3284591f8947 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:18.160619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5cb4c-02d3-4730-8ecf-2d6a39705c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:18.161280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5cb4c-02d3-4730-8ecf-2d6a39705c85 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:18.161569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5cb4c-02d3-4730-8ecf-2d6a39705c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:18.161848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5cb4c-02d3-4730-8ecf-2d6a39705c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:18.162696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5cb4c-02d3-4730-8ecf-2d6a39705c85 None admin] RBAC: Adding query filter params (role.id=e9285b302841419aab0d26cdb9b15b46, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=abbda90b98bd49569e59c973edba73b4) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:18.163013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5cb4c-02d3-4730-8ecf-2d6a39705c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:18.164471 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5cb4c-02d3-4730-8ecf-2d6a39705c85 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:18.179521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 502/1034] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:18 2022] GET /identity/v3/role_assignments?user.id=abbda90b98bd49569e59c973edba73b4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=e9285b302841419aab0d26cdb9b15b46 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:19.146778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9f85-9880-4a39-9a54-7e00ce9db7b0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.147363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9f85-9880-4a39-9a54-7e00ce9db7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.147363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9f85-9880-4a39-9a54-7e00ce9db7b0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.148766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 533/1035] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:19.154658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8631b-7eb6-4468-9f24-98aad2b6cb92 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.155138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8631b-7eb6-4468-9f24-98aad2b6cb92 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.155222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8631b-7eb6-4468-9f24-98aad2b6cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.171817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-d8e8631b-7eb6-4468-9f24-98aad2b6cb92 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:19.173017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d8e8631b-7eb6-4468-9f24-98aad2b6cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:19.242253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 503/1036] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:19.265218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c9f85-9880-4a39-9a54-7e00ce9db7b0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:19.367602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c9f85-9880-4a39-9a54-7e00ce9db7b0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:19.400263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:19.400971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.401247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.401515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] PATH_INFO: `/v3/services/image` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.402709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:19.404236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:19.415344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:19.416456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:19.417413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:19.419797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 534/1037] 10.222.0.55 () {56 vars in 1105 bytes} [Thu May 5 15:11:19 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:19.422598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8631b-7eb6-4468-9f24-98aad2b6cb92 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:19.535371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8631b-7eb6-4468-9f24-98aad2b6cb92 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:19.579427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbae49-e90d-43df-ba39-3ca03c6b8fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:19.580125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbae49-e90d-43df-ba39-3ca03c6b8fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.580410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbae49-e90d-43df-ba39-3ca03c6b8fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.580686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbae49-e90d-43df-ba39-3ca03c6b8fd8 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.581394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbae49-e90d-43df-ba39-3ca03c6b8fd8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:19.581699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbae49-e90d-43df-ba39-3ca03c6b8fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:19.583051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbae49-e90d-43df-ba39-3ca03c6b8fd8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:19.592488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 504/1038] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:19.594075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:19.688444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b01b0-9500-4956-b2d6-52979633f18d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.688648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b01b0-9500-4956-b2d6-52979633f18d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.688911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b01b0-9500-4956-b2d6-52979633f18d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.690400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 505/1039] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:19.690756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb643-69bb-4ba7-9049-fef875e1042d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:19.695340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218b89-9f48-42ec-a88e-081a529c18dd None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.695657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218b89-9f48-42ec-a88e-081a529c18dd None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.695935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218b89-9f48-42ec-a88e-081a529c18dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.712401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0e218b89-9f48-42ec-a88e-081a529c18dd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:19.713576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0e218b89-9f48-42ec-a88e-081a529c18dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:19.724750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:19.725416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.725700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.725971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.726683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] RBAC: Adding query filter params (type=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:19.726979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:19.728372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:19.738516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 535/1040] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:19.740865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:19.784588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 506/1041] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:19.810000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218b89-9f48-42ec-a88e-081a529c18dd None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:19.848155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de437f11-ac9a-4f85-9605-8914b62d4791 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:19.883025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:19.883856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.884142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.884417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.885221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] RBAC: Adding query filter params (interface=public, service_id=78c486a4ff104a64aafcd765f4d58c08, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:19.885531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:19.887761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:19.898145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 536/1042] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:11:19 2022] GET /identity/v3/endpoints?service_id=78c486a4ff104a64aafcd765f4d58c08&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:19.901060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:19.926572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218b89-9f48-42ec-a88e-081a529c18dd None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:19.973682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:19.974396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:19.974738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:19.974946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:19.976116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:19.977541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:19.979302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 507/1043] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:19.985196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:20.005957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7ccf-bec1-4cf0-97b3-ac6ecc6a8a60 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:20.039776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06685b5e-95f6-4cfe-9120-94848a87b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:20.040405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685b5e-95f6-4cfe-9120-94848a87b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:20.040683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685b5e-95f6-4cfe-9120-94848a87b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:20.040956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685b5e-95f6-4cfe-9120-94848a87b6a3 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:20.041630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06685b5e-95f6-4cfe-9120-94848a87b6a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:20.043045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06685b5e-95f6-4cfe-9120-94848a87b6a3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:20.049729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 537/1044] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:11:19 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:11:20.101777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211c41b-e265-42e4-97b3-05acc30a2008 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:20.150851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f184ec-23fe-42eb-95bd-a545f7f5b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:20.151576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f184ec-23fe-42eb-95bd-a545f7f5b11a None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:20.151865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f184ec-23fe-42eb-95bd-a545f7f5b11a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:20.152682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f184ec-23fe-42eb-95bd-a545f7f5b11a None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:20.153418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f184ec-23fe-42eb-95bd-a545f7f5b11a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:20.154905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f184ec-23fe-42eb-95bd-a545f7f5b11a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:20.271421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 508/1045] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:11:19 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:11:20.486213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adffa5-b2ec-42ff-86e0-4854bc242d40 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:20.486761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adffa5-b2ec-42ff-86e0-4854bc242d40 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:20.486761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adffa5-b2ec-42ff-86e0-4854bc242d40 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:20.488402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 538/1046] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:20.496570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425070-2760-4f18-9953-2a4a107d8ed4 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:20.496939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425070-2760-4f18-9953-2a4a107d8ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:20.497279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425070-2760-4f18-9953-2a4a107d8ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:20.514415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-53425070-2760-4f18-9953-2a4a107d8ed4 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:20.515681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-53425070-2760-4f18-9953-2a4a107d8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:20.596726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 509/1047] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:20.621946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adffa5-b2ec-42ff-86e0-4854bc242d40 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:20.736358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adffa5-b2ec-42ff-86e0-4854bc242d40 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:20.779177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:20.780036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:20.780383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:20.780603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:20.791193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:20.800046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:20.801034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:20.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:20.810387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 539/1048] 10.222.0.55 () {56 vars in 1120 bytes} [Thu May 5 15:11:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:20.810565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425070-2760-4f18-9953-2a4a107d8ed4 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:20.924249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425070-2760-4f18-9953-2a4a107d8ed4 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:20.961472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:20.962149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:20.962436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:20.962715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:20.963488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:20.963846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:20.965713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:20.976604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 510/1049] 10.222.0.55 () {56 vars in 1115 bytes} [Thu May 5 15:11:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:20.983167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:21.084695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac91ee-364b-470a-aa1d-0f5f32a4486e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:21.121817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:21.122623 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:21.123620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:21.123620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:21.136471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:21.138734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:21.158146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:21.159113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:21.161020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:21.161020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:21.161020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:21.161020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:21.161822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 540/1050] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:21.165189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:21.295098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472fc6d-5c99-410e-a6ed-3b7412b6e5f8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:21.334197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:21.334853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:21.335131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:21.335404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:21.336886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:21.336886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:21.339210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:21.355963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 511/1051] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:21.357666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:21.471758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdcc24-fe93-4bb9-b0d5-a245397cb502 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:21.510218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:21.511051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:21.511342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:21.511660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:21.520995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:21.522466 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:11:21.544880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:21.546235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:11:21.548348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:21.549349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 541/1052] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:11:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:21.554559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:21.673161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217e902-751f-4800-b9bd-1c2b29135b72 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:21.711524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:21.712201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:21.712486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:21.712763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:21.713598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:21.713906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:21.715383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:21.737757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 512/1053] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:11:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:21.740266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:21.847364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae710-1d84-4366-8aba-bd54d3e10585 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:21.893862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:21.894670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:21.894954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:21.895273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:21.908015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:21.909494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:21.936781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:21.937774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:21.938726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:21.938726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:21.938726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:21.938726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:21.939553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 542/1054] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:21.944053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.062268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f866e5-21f8-4698-b870-2fa601c1060d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:22.100259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:22.100839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.101121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.101392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.102116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:22.102419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:22.103802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:22.119669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 513/1055] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:22.121826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.255370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd5f3-6e16-4617-9611-2bf9505c22fc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:22.292753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64704082-b84b-4fb8-b63f-1f268ab31eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:22.293551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704082-b84b-4fb8-b63f-1f268ab31eba None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.293828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704082-b84b-4fb8-b63f-1f268ab31eba None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.294094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704082-b84b-4fb8-b63f-1f268ab31eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.301051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64704082-b84b-4fb8-b63f-1f268ab31eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:22.302495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64704082-b84b-4fb8-b63f-1f268ab31eba None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-64704082-b84b-4fb8-b63f-1f268ab31eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:11:22.317549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:22.318570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:22.324988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 543/1056] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:22.327084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.367028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c1dc-7abb-4941-a611-23befddead69 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.367328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c1dc-7abb-4941-a611-23befddead69 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.367617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c1dc-7abb-4941-a611-23befddead69 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.369077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 544/1057] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:22.374677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15b59-55eb-472d-a3c4-31053c78db5a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.374963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15b59-55eb-472d-a3c4-31053c78db5a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.375241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15b59-55eb-472d-a3c4-31053c78db5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.395226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-15a15b59-55eb-472d-a3c4-31053c78db5a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:22.396451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-15a15b59-55eb-472d-a3c4-31053c78db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:22.437102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75246-07d4-491f-af89-5bffc6f9dd5d None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:22.473762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 545/1058] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:22.475491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:22.476684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.476684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.477441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.477663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:22.477938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:22.479424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:22.499093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 514/1059] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:11:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:22.500450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a15b59-55eb-472d-a3c4-31053c78db5a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.500665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.609606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a15b59-55eb-472d-a3c4-31053c78db5a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:22.610174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71229-b10e-4c98-b7cb-1aa615c95b04 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:22.644800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464448e-c3dc-48b7-b15b-488b051ff8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:22.645571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469b98a-d943-43b1-a4d8-023c51bb77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:22.646204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464448e-c3dc-48b7-b15b-488b051ff8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.646469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b98a-d943-43b1-a4d8-023c51bb77e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.646751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b98a-d943-43b1-a4d8-023c51bb77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.647027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b98a-d943-43b1-a4d8-023c51bb77e7 None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/abbda90b98bd49569e59c973edba73b4/roles/e9285b302841419aab0d26cdb9b15b46` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.647366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464448e-c3dc-48b7-b15b-488b051ff8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.647883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464448e-c3dc-48b7-b15b-488b051ff8c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.648749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464448e-c3dc-48b7-b15b-488b051ff8c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:22.649334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469b98a-d943-43b1-a4d8-023c51bb77e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=abbda90b98bd49569e59c973edba73b4, role_id=e9285b302841419aab0d26cdb9b15b46)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:22.650583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464448e-c3dc-48b7-b15b-488b051ff8c7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:22.650840 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469b98a-d943-43b1-a4d8-023c51bb77e7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e464448e-c3dc-48b7-b15b-488b051ff8c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:22.663152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:22.664853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:22.665998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 546/1060] 10.222.0.55 () {56 vars in 1105 bytes} [Thu May 5 15:11:22 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:22.666957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3805-86ac-4dc1-8174-0a276ed533d7 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.667324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3805-86ac-4dc1-8174-0a276ed533d7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.668378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3805-86ac-4dc1-8174-0a276ed533d7 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.670487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 547/1061] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:22.671251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3805-86ac-4dc1-8174-0a276ed533d7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.764939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 515/1062] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:11:22 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/abbda90b98bd49569e59c973edba73b4/roles/e9285b302841419aab0d26cdb9b15b46 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:11:22.766387 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711082da-3d4e-4458-8fb0-4db97246c123 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.766783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711082da-3d4e-4458-8fb0-4db97246c123 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.767158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711082da-3d4e-4458-8fb0-4db97246c123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.772567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3805-86ac-4dc1-8174-0a276ed533d7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:22.786841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-711082da-3d4e-4458-8fb0-4db97246c123 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:22.788120 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-711082da-3d4e-4458-8fb0-4db97246c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:22.816201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:22.816987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:22.817364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:22.817701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:22.818486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] RBAC: Adding query filter params (name=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:22.818893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:22.820453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:22.831374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 548/1063] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:22.834050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.869255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 516/1064] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:22.893828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711082da-3d4e-4458-8fb0-4db97246c123 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:22.958571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260c64d-63f3-4af3-9811-c7875aaea94f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:23.012908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:23.013589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:23.013922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:23.014168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:23.014847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] RBAC: Adding query filter params (type=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:23.015313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:23.016635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:23.019776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711082da-3d4e-4458-8fb0-4db97246c123 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:23.022093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 549/1065] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:23.028132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:23.059604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:23.060456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:23.060738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:23.061024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:23.071738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:23.080023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:23.081210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:23.082087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 517/1066] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:11:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:23.087128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:23.147836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd43b-b8c4-404e-8934-0131dfadefab None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:23.192152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:23.192820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:23.193109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:23.193387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:23.194128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:23.195673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:23.201619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040194b6-9cb4-4976-a386-5f94c1be3a04 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:23.240180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:23.241116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:23.241397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:23.241681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:23.242436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:23.242742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:23.244162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:23.253438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 518/1067] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:23.259072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:23.275500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 550/1068] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:11:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:11:23.380380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6472e-84e0-4693-9a92-1a865adf6be7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:23.427049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:23.428019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:23.428292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:23.428615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] PATH_INFO: `/v3/users/b3f3d5a7e6e74a6289d7df344dacab0c` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:23.444547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] RBAC: Authorizing `identity:get_user(user_id=b3f3d5a7e6e74a6289d7df344dacab0c)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:23.446010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:23.451883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 519/1069] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:23 2022] GET /identity/v3/users/b3f3d5a7e6e74a6289d7df344dacab0c => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:23.453644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:23.559970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4d85-6e3d-4457-9c5a-168b13e05eff None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:23.594310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:23.594955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:23.595319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:23.595620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:23.666861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:23.668888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:23.779571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 551/1070] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:23.782361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:23.900902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057b02-0b70-4fdb-8302-29c1efe2b2af None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:23.946476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443eda8-671c-4fe4-ad82-0acdab597759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:23.947709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443eda8-671c-4fe4-ad82-0acdab597759 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:23.948389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443eda8-671c-4fe4-ad82-0acdab597759 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:23.949022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443eda8-671c-4fe4-ad82-0acdab597759 None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:23.951090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443eda8-671c-4fe4-ad82-0acdab597759 None admin] RBAC: Authorizing `identity:get_project(project_id=c26a65af1a7244c8a9e34ebd8646c001)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:23.954037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443eda8-671c-4fe4-ad82-0acdab597759 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:23.963502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 520/1071] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:23 2022] GET /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:23.967988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:24.107024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286aa6e-dd98-43db-98e0-2f7787dec815 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:24.163249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255881f0-787d-4517-84a7-e53cd05a96bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:24.163493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255881f0-787d-4517-84a7-e53cd05a96bf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:24.163737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255881f0-787d-4517-84a7-e53cd05a96bf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:24.166195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255881f0-787d-4517-84a7-e53cd05a96bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:24.167695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255881f0-787d-4517-84a7-e53cd05a96bf None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=c26a65af1a7244c8a9e34ebd8646c001, user.id=b3f3d5a7e6e74a6289d7df344dacab0c) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:24.168033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255881f0-787d-4517-84a7-e53cd05a96bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:24.169500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255881f0-787d-4517-84a7-e53cd05a96bf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:24.183736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 552/1072] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:23 2022] GET /identity/v3/role_assignments?user.id=b3f3d5a7e6e74a6289d7df344dacab0c&scope.project.id=c26a65af1a7244c8a9e34ebd8646c001&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:25.111232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dd5b1-a318-4883-8a48-17f919f6d3ad None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.111768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dd5b1-a318-4883-8a48-17f919f6d3ad None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.111768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dd5b1-a318-4883-8a48-17f919f6d3ad None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.113162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 521/1073] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:25.118629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fcfed-84a7-4afb-8b33-f7d4ce0a78be None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.119077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fcfed-84a7-4afb-8b33-f7d4ce0a78be None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.119251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fcfed-84a7-4afb-8b33-f7d4ce0a78be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.136009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a64fcfed-84a7-4afb-8b33-f7d4ce0a78be None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:25.137497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a64fcfed-84a7-4afb-8b33-f7d4ce0a78be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:25.202319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 553/1074] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:25.225074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dd5b1-a318-4883-8a48-17f919f6d3ad None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:25.325121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dd5b1-a318-4883-8a48-17f919f6d3ad None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:25.367071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:25.370381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.370381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.370381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.381041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:25.389505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:25.390425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:11:25.391293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:25.395790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 522/1075] 10.222.0.55 () {56 vars in 1120 bytes} [Thu May 5 15:11:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:25.397564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fcfed-84a7-4afb-8b33-f7d4ce0a78be None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:25.496875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fcfed-84a7-4afb-8b33-f7d4ce0a78be None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:25.531518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845633a-a49b-48bb-acec-c988935529c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:25.532194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845633a-a49b-48bb-acec-c988935529c9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.532477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845633a-a49b-48bb-acec-c988935529c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.532753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845633a-a49b-48bb-acec-c988935529c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.533496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845633a-a49b-48bb-acec-c988935529c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:25.533802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845633a-a49b-48bb-acec-c988935529c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:25.535165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845633a-a49b-48bb-acec-c988935529c9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:25.543739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 554/1076] 10.222.0.55 () {56 vars in 1115 bytes} [Thu May 5 15:11:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:25.549262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:25.645673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14844b6-43e1-4b59-a30e-98720a01d52e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:25.668720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d44f4-0603-4f2c-bd60-3783d0b0f7b4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.669237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d44f4-0603-4f2c-bd60-3783d0b0f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.669342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d44f4-0603-4f2c-bd60-3783d0b0f7b4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.670808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 555/1077] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:25.675536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c630-4f06-4fcb-92bf-d4c975731780 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.675823 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c630-4f06-4fcb-92bf-d4c975731780 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.676100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c630-4f06-4fcb-92bf-d4c975731780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.679645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:25.680496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.680782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.681061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.692327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:25.693217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fef4c630-4f06-4fcb-92bf-d4c975731780 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:25.693703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:25.694391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fef4c630-4f06-4fcb-92bf-d4c975731780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:25.710744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:25.711903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:25.713018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:25.713018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:25.713018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:25.713018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:25.715635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 523/1078] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:25.717651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:25.799525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 556/1079] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:25.821488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4c630-4f06-4fcb-92bf-d4c975731780 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:25.827788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25558-8afc-400c-bbe9-1eee89c11a30 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:25.861320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:25.861984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.862266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.862540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.863274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:25.863592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:25.864957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:25.877757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 524/1080] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:25.883234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:25.921864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4c630-4f06-4fcb-92bf-d4c975731780 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:25.954512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:25.955159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:25.955439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:25.955744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:25.985243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490be39-d2cd-4059-9738-37389af84314 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.024094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.024888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.025168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.025440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.025539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.026896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.032732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.034363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:11:26.049330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:26.050324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:26.051259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 525/1081] 10.222.0.55 () {56 vars in 1093 bytes} [Thu May 5 15:11:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:26.056220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.127721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 557/1082] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:11:26.133209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.157574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5a1d4-acb9-49a7-8ff1-4b9f65104ebb None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.194924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.195562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.195854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.196132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.197006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:26.197287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.199291 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.218672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 526/1083] 10.222.0.55 () {56 vars in 1133 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:26.224262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.229236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83730398-bc5e-4ec2-9711-ef9e750ca9c8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.263320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.264134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.264416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.264689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.274720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.276211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:26.295484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:26.296501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:26.297442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:26.297442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:26.297442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:26.297442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:26.297442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 558/1084] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:26.302978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.328808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb02f-0a1c-4d74-ae66-47104f75746b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.362992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.363678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.363965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.364243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.405115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16e78c-5b52-4a71-a5e2-ab972de6c6c3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.434460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.436068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.438195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d2c2f-5ad9-4f2f-8203-c1f19672dbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.439077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d2c2f-5ad9-4f2f-8203-c1f19672dbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.439361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d2c2f-5ad9-4f2f-8203-c1f19672dbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.439670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d2c2f-5ad9-4f2f-8203-c1f19672dbb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.440393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d2c2f-5ad9-4f2f-8203-c1f19672dbb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:26.440703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d2c2f-5ad9-4f2f-8203-c1f19672dbb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.442072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d2c2f-5ad9-4f2f-8203-c1f19672dbb1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.467582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 559/1085] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:26.483650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3c27-f3d1-444f-bb78-5cea58885b87 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.484040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3c27-f3d1-444f-bb78-5cea58885b87 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.484323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3c27-f3d1-444f-bb78-5cea58885b87 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.485802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 560/1086] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:26.491768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e33d-e8ff-42d3-8c6c-1aaafa3a843a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.492061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e33d-e8ff-42d3-8c6c-1aaafa3a843a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.492352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e33d-e8ff-42d3-8c6c-1aaafa3a843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.509452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0c44e33d-e8ff-42d3-8c6c-1aaafa3a843a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:26.511947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0c44e33d-e8ff-42d3-8c6c-1aaafa3a843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:26.543820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 527/1087] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:11:26.549369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.583088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 561/1088] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:26.606127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e33d-e8ff-42d3-8c6c-1aaafa3a843a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.655441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde24674-ef9a-429f-8b7c-a9e810006d05 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.690334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.691814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.692100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.692480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.704331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.706464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.710183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e33d-e8ff-42d3-8c6c-1aaafa3a843a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:26.724897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:26.725941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:26.726978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:26.726978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:26.726978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:26.726978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:26.726978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 528/1089] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:26.733439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.756885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.757671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.757955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.758232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.770577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:26.778776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:26.780060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:26.780925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 562/1090] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:26.785979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.837049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88187dc2-60d0-4178-b362-a5785fe31222 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.868966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.869623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.869901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.870175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.871067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:26.871367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.872779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.880419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973339d6-dea8-4d99-a673-2bccde39c116 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:26.883804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 529/1091] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:26.889552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.913405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:26.914076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:26.914360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:26.914637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:26.915371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:26.915704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:26.917065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:26.925434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 563/1092] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:26.931568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:26.984872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceae9c-e1c5-4bcc-9a4b-843bbdcc81c7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:27.016564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:27.017357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:27.017647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:27.017927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:27.024568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:27.026017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa75c5-0546-471a-9511-571a04b68d2e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:27.026122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:11:27.040419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:27.041352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:27.042878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 530/1093] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:27.048043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:27.059486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:27.060364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:27.060651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:27.060926 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] PATH_INFO: `/v3/users/b3f3d5a7e6e74a6289d7df344dacab0c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:27.062117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] RBAC: Authorizing `identity:get_user(user_id=b3f3d5a7e6e74a6289d7df344dacab0c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:27.063561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:27.065322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 564/1094] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:26 2022] GET /identity/v3/users/b3f3d5a7e6e74a6289d7df344dacab0c => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:27.071106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:27.142477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24355-5748-44bc-a9c4-ba70e17242c0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:27.164362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878e207-62b2-4929-a086-2c7e76e3b2da None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:27.174441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:27.175091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:27.175373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:27.175679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:27.176458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:27.176770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:27.178189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:27.189706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 531/1095] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:27.195773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:27.196764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:27.197627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:27.197907 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:27.198184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:27.199411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] RBAC: Authorizing `identity:get_project(project_id=c26a65af1a7244c8a9e34ebd8646c001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:27.200859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:27.202542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 565/1096] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:27 2022] GET /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:27.208261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:27.288749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1d65-4ef2-409a-9acd-2ea009f245f6 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:27.302398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c6b93-e7cc-48c9-828e-a6b6bffb03c6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:27.321235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bef2b-fb7e-419c-a1e2-c4650fb0fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:27.321892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bef2b-fb7e-419c-a1e2-c4650fb0fd32 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:27.322172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bef2b-fb7e-419c-a1e2-c4650fb0fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:27.322447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bef2b-fb7e-419c-a1e2-c4650fb0fd32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:27.323266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bef2b-fb7e-419c-a1e2-c4650fb0fd32 None admin] RBAC: Adding query filter params (role.id=e9285b302841419aab0d26cdb9b15b46, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=abbda90b98bd49569e59c973edba73b4) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:27.323626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bef2b-fb7e-419c-a1e2-c4650fb0fd32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:27.325041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bef2b-fb7e-419c-a1e2-c4650fb0fd32 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:27.330767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 532/1097] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:27 2022] GET /identity/v3/role_assignments?user.id=abbda90b98bd49569e59c973edba73b4&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=e9285b302841419aab0d26cdb9b15b46 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:27.334774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef8da-c003-4d75-9bfd-cdc8c4794f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:27.335694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef8da-c003-4d75-9bfd-cdc8c4794f4f None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:27.335981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef8da-c003-4d75-9bfd-cdc8c4794f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:27.336260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef8da-c003-4d75-9bfd-cdc8c4794f4f None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001/users/b3f3d5a7e6e74a6289d7df344dacab0c/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:27.338319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffef8da-c003-4d75-9bfd-cdc8c4794f4f None admin] RBAC: Authorizing `identity:create_grant(project_id=c26a65af1a7244c8a9e34ebd8646c001, user_id=b3f3d5a7e6e74a6289d7df344dacab0c, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:27.339826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffef8da-c003-4d75-9bfd-cdc8c4794f4f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:27.441993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 566/1098] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:11:27 2022] PUT /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001/users/b3f3d5a7e6e74a6289d7df344dacab0c/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:11:29.663160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c49d5-a967-4b2e-bd10-b650d62c4ca2 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:29.663759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c49d5-a967-4b2e-bd10-b650d62c4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:29.663759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c49d5-a967-4b2e-bd10-b650d62c4ca2 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:29.665123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 533/1099] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:29.670428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96558e-c145-4560-98d6-8eb35cadf38f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:29.670833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96558e-c145-4560-98d6-8eb35cadf38f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:29.670984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96558e-c145-4560-98d6-8eb35cadf38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:29.687315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8a96558e-c145-4560-98d6-8eb35cadf38f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:29.688512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8a96558e-c145-4560-98d6-8eb35cadf38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:29.752287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 567/1100] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:29.776403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c49d5-a967-4b2e-bd10-b650d62c4ca2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:29.872301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c49d5-a967-4b2e-bd10-b650d62c4ca2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:29.904265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:29.905122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:29.905363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:29.905638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:29.916996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:29.925118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:29.926310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:29.927374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 534/1101] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:11:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:29.934346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96558e-c145-4560-98d6-8eb35cadf38f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:30.025893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96558e-c145-4560-98d6-8eb35cadf38f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:30.061156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:30.061818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:30.062100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:30.062376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:30.063109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:30.063415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:30.064794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:30.072580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 568/1102] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:11:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:30.078888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:30.171968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4650-e89e-4266-9be1-4ff24b9667a0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:30.202955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:30.203824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:30.204107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:30.204383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] PATH_INFO: `/v3/users/b3f3d5a7e6e74a6289d7df344dacab0c` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:30.205540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] RBAC: Authorizing `identity:get_user(user_id=b3f3d5a7e6e74a6289d7df344dacab0c)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:30.206955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:30.208573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 535/1103] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:30 2022] GET /identity/v3/users/b3f3d5a7e6e74a6289d7df344dacab0c => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:30.214344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:30.314994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed9e7-54c3-4227-8fa3-1a9dd546a730 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:30.347619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:30.348268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:30.348555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:30.348888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:30.413694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:30.415149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:30.507740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 569/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:30.514165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:30.608473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced528e-9cd1-437e-b71c-76197f756672 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:30.640599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0270fc-32b3-486d-b856-0a646b593e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:30.641447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0270fc-32b3-486d-b856-0a646b593e35 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:30.641732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0270fc-32b3-486d-b856-0a646b593e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:30.642010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0270fc-32b3-486d-b856-0a646b593e35 None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:30.643181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0270fc-32b3-486d-b856-0a646b593e35 None admin] RBAC: Authorizing `identity:get_project(project_id=c26a65af1a7244c8a9e34ebd8646c001)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:30.644637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0270fc-32b3-486d-b856-0a646b593e35 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:30.646320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 536/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:30 2022] GET /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:30.652524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:30.745077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341554-af1a-40b9-81fa-c62635cd92a3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:30.779072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38697a60-abee-4876-97fb-5c67c60478fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:30.779676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38697a60-abee-4876-97fb-5c67c60478fe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:30.779960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38697a60-abee-4876-97fb-5c67c60478fe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:30.780234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38697a60-abee-4876-97fb-5c67c60478fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:30.781046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38697a60-abee-4876-97fb-5c67c60478fe None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=c26a65af1a7244c8a9e34ebd8646c001, user.id=b3f3d5a7e6e74a6289d7df344dacab0c) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:30.781357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38697a60-abee-4876-97fb-5c67c60478fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:30.782770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38697a60-abee-4876-97fb-5c67c60478fe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:30.788600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 570/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:30 2022] GET /identity/v3/role_assignments?user.id=b3f3d5a7e6e74a6289d7df344dacab0c&scope.project.id=c26a65af1a7244c8a9e34ebd8646c001&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:33.058820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54d1f6-5767-4adc-991d-83450a5f54d5 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:33.059343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54d1f6-5767-4adc-991d-83450a5f54d5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:33.059343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54d1f6-5767-4adc-991d-83450a5f54d5 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:33.060690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 537/1107] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:33.065920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ffbc7-8735-4cb4-92ae-50754cd13082 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:33.066302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ffbc7-8735-4cb4-92ae-50754cd13082 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:33.066470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ffbc7-8735-4cb4-92ae-50754cd13082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:33.083287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-259ffbc7-8735-4cb4-92ae-50754cd13082 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:33.084496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-259ffbc7-8735-4cb4-92ae-50754cd13082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:33.147956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 571/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:33.172851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54d1f6-5767-4adc-991d-83450a5f54d5 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:33.270078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54d1f6-5767-4adc-991d-83450a5f54d5 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:33.302224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbee83d-a4c9-4d20-b77a-5745aaaa78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:33.303007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee83d-a4c9-4d20-b77a-5745aaaa78a3 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:33.303288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee83d-a4c9-4d20-b77a-5745aaaa78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:33.303592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee83d-a4c9-4d20-b77a-5745aaaa78a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:33.304747 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbee83d-a4c9-4d20-b77a-5745aaaa78a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:33.306164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbee83d-a4c9-4d20-b77a-5745aaaa78a3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:33.308360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 538/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:33.314070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ffbc7-8735-4cb4-92ae-50754cd13082 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:33.415021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ffbc7-8735-4cb4-92ae-50754cd13082 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:33.448349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a18fe3-3ecb-4a40-b6ea-57ce38309cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:33.449011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18fe3-3ecb-4a40-b6ea-57ce38309cf3 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:33.449290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18fe3-3ecb-4a40-b6ea-57ce38309cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:33.449566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18fe3-3ecb-4a40-b6ea-57ce38309cf3 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:33.450270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a18fe3-3ecb-4a40-b6ea-57ce38309cf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:33.451710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a18fe3-3ecb-4a40-b6ea-57ce38309cf3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:33.559430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 572/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:11:33 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:35.832829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdf65-c66f-49af-b760-9f719bc97793 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:35.833348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdf65-c66f-49af-b760-9f719bc97793 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:35.833454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdf65-c66f-49af-b760-9f719bc97793 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:35.834746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 539/1111] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:35.839987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c465-c887-49b8-abff-a7253be7b031 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:35.840419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c465-c887-49b8-abff-a7253be7b031 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:35.840553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c465-c887-49b8-abff-a7253be7b031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:35.856970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3f56c465-c887-49b8-abff-a7253be7b031 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:35.858141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3f56c465-c887-49b8-abff-a7253be7b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:35.921243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 573/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:35.944700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bdf65-c66f-49af-b760-9f719bc97793 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:36.038975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bdf65-c66f-49af-b760-9f719bc97793 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:36.070304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:36.071141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:36.071427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:36.071742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] PATH_INFO: `/v3/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:36.073744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] RBAC: Authorizing `identity:get_role(role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:36.076104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:36.077987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 540/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:35 2022] GET /identity/v3/roles/5656ec6c481b4cdf9cefe78698198023 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:36.083677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c465-c887-49b8-abff-a7253be7b031 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:36.194203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c465-c887-49b8-abff-a7253be7b031 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:36.225272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:36.226131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:36.226414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:36.226689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] PATH_INFO: `/v3/users/d9205c8ea0764da789bae09aff5b2685` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:36.239572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] RBAC: Authorizing `identity:get_user(user_id=d9205c8ea0764da789bae09aff5b2685)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:36.241002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:36.242644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 574/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:36 2022] GET /identity/v3/users/d9205c8ea0764da789bae09aff5b2685 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:36.249076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:36.341456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b384-371a-415c-a8bf-9a8797a34aa5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:36.373152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:36.373781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:36.374062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:36.374338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:36.436975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:36.438414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:36.540363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 541/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:36.546862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:36.640482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6a843-89db-4b4a-b59a-c33fb853fae3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:36.671456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663f817-152c-428b-97cc-673760f9066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:36.672324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663f817-152c-428b-97cc-673760f9066a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:36.672610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663f817-152c-428b-97cc-673760f9066a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:36.672888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663f817-152c-428b-97cc-673760f9066a None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:36.674056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663f817-152c-428b-97cc-673760f9066a None admin] RBAC: Authorizing `identity:get_project(project_id=c26a65af1a7244c8a9e34ebd8646c001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:36.675513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663f817-152c-428b-97cc-673760f9066a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:36.677191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 575/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:36 2022] GET /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:36.683782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:36.776794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aac71-35eb-436a-9d88-9097014c527c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:36.815097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb37ed-a95f-42a9-a8c1-e821727a11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:36.815784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb37ed-a95f-42a9-a8c1-e821727a11a9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:36.816070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb37ed-a95f-42a9-a8c1-e821727a11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:36.816348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb37ed-a95f-42a9-a8c1-e821727a11a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:36.817174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb37ed-a95f-42a9-a8c1-e821727a11a9 None admin] RBAC: Adding query filter params (role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=c26a65af1a7244c8a9e34ebd8646c001, user.id=d9205c8ea0764da789bae09aff5b2685) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:36.817488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb37ed-a95f-42a9-a8c1-e821727a11a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:36.818917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb37ed-a95f-42a9-a8c1-e821727a11a9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:36.824783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 542/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:36 2022] GET /identity/v3/role_assignments?user.id=d9205c8ea0764da789bae09aff5b2685&scope.project.id=c26a65af1a7244c8a9e34ebd8646c001&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:39.054573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364eb00-06f7-4f23-8885-754b22823e03 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:39.055136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364eb00-06f7-4f23-8885-754b22823e03 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:39.055136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364eb00-06f7-4f23-8885-754b22823e03 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:39.056464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 576/1118] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:39.062419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36c57b-600b-43e6-9e9d-7b660c872c9b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:39.062816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36c57b-600b-43e6-9e9d-7b660c872c9b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:39.062976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36c57b-600b-43e6-9e9d-7b660c872c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:39.079616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-2c36c57b-600b-43e6-9e9d-7b660c872c9b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:39.080787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2c36c57b-600b-43e6-9e9d-7b660c872c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:39.142868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 543/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:39.164816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364eb00-06f7-4f23-8885-754b22823e03 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:39.264097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364eb00-06f7-4f23-8885-754b22823e03 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:39.295777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:39.296616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:39.296897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:39.297169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] PATH_INFO: `/v3/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:39.298630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] RBAC: Authorizing `identity:get_role(role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:39.300021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:39.301387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 577/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:39 2022] GET /identity/v3/roles/5656ec6c481b4cdf9cefe78698198023 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:39.307967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36c57b-600b-43e6-9e9d-7b660c872c9b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:39.399482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36c57b-600b-43e6-9e9d-7b660c872c9b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:39.431251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:39.432131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:39.432953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:39.433231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] PATH_INFO: `/v3/users/d9205c8ea0764da789bae09aff5b2685` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:39.434405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] RBAC: Authorizing `identity:get_user(user_id=d9205c8ea0764da789bae09aff5b2685)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:39.435851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:39.437463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 544/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:39 2022] GET /identity/v3/users/d9205c8ea0764da789bae09aff5b2685 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:39.443537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:39.536672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce933752-5de2-4c0b-9c17-a6e2be2c2687 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:39.568332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277340f9-44cb-473e-abbe-d04ac5bbb1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:39.569184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277340f9-44cb-473e-abbe-d04ac5bbb1ee None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:39.569469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277340f9-44cb-473e-abbe-d04ac5bbb1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:39.569744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277340f9-44cb-473e-abbe-d04ac5bbb1ee None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:39.570918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277340f9-44cb-473e-abbe-d04ac5bbb1ee None admin] RBAC: Authorizing `identity:get_project(project_id=c26a65af1a7244c8a9e34ebd8646c001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:39.572375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277340f9-44cb-473e-abbe-d04ac5bbb1ee None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:39.574091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 578/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:39 2022] GET /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:39.580311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:39.674045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d1a1-8717-408c-b129-4c6d348ffaf7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:39.705353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2206b3d-6c99-4653-a376-d676e8aa9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:39.706217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2206b3d-6c99-4653-a376-d676e8aa9d22 None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:39.706502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2206b3d-6c99-4653-a376-d676e8aa9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:39.706784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2206b3d-6c99-4653-a376-d676e8aa9d22 None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001/users/d9205c8ea0764da789bae09aff5b2685/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:39.708980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2206b3d-6c99-4653-a376-d676e8aa9d22 None admin] RBAC: Authorizing `identity:create_grant(project_id=c26a65af1a7244c8a9e34ebd8646c001, user_id=d9205c8ea0764da789bae09aff5b2685, role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:39.710381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2206b3d-6c99-4653-a376-d676e8aa9d22 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:39.792592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 545/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:11:39 2022] PUT /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001/users/d9205c8ea0764da789bae09aff5b2685/roles/5656ec6c481b4cdf9cefe78698198023 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:11:42.001701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d04e-2812-4cb7-91eb-7dda9c59ebff None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:42.002224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d04e-2812-4cb7-91eb-7dda9c59ebff None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:42.002224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d04e-2812-4cb7-91eb-7dda9c59ebff None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:42.003689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 579/1124] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:42.008827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18eec-6959-4c14-94d0-c36cfc1b0333 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:42.009257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18eec-6959-4c14-94d0-c36cfc1b0333 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:42.009391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18eec-6959-4c14-94d0-c36cfc1b0333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:42.026308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f5a18eec-6959-4c14-94d0-c36cfc1b0333 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:42.027502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f5a18eec-6959-4c14-94d0-c36cfc1b0333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:42.089338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 546/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:11:42.112693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d04e-2812-4cb7-91eb-7dda9c59ebff None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:42.214888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d04e-2812-4cb7-91eb-7dda9c59ebff None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:42.245836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:42.246676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:42.246962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:42.247237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] PATH_INFO: `/v3/roles/5656ec6c481b4cdf9cefe78698198023` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:42.248735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] RBAC: Authorizing `identity:get_role(role_id=5656ec6c481b4cdf9cefe78698198023)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:42.250093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:42.251443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 580/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:42 2022] GET /identity/v3/roles/5656ec6c481b4cdf9cefe78698198023 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:42.257296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18eec-6959-4c14-94d0-c36cfc1b0333 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:42.352428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18eec-6959-4c14-94d0-c36cfc1b0333 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:42.384225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:42.385089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:42.386148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:42.386434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] PATH_INFO: `/v3/users/d9205c8ea0764da789bae09aff5b2685` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:42.387634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] RBAC: Authorizing `identity:get_user(user_id=d9205c8ea0764da789bae09aff5b2685)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:42.389055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:42.390668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 547/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:42 2022] GET /identity/v3/users/d9205c8ea0764da789bae09aff5b2685 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:42.396520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:42.490717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d1ae-bec5-49b1-a34a-83ae6e3a30f2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:42.522875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:42.523449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:42.523759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:42.524031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:42.587954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:42.589403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:42.680162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 581/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:42.686579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:42.788764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1c61-a7a8-4faa-9415-d18f15b627a0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:42.824175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d7ac3-260a-4c17-9e99-3fa6be0fad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:42.825361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7ac3-260a-4c17-9e99-3fa6be0fad72 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:42.825813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7ac3-260a-4c17-9e99-3fa6be0fad72 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:42.826102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7ac3-260a-4c17-9e99-3fa6be0fad72 None admin] PATH_INFO: `/v3/projects/c26a65af1a7244c8a9e34ebd8646c001` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:42.827313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d7ac3-260a-4c17-9e99-3fa6be0fad72 None admin] RBAC: Authorizing `identity:get_project(project_id=c26a65af1a7244c8a9e34ebd8646c001)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:42.828807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d7ac3-260a-4c17-9e99-3fa6be0fad72 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:42.830538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 548/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:42 2022] GET /identity/v3/projects/c26a65af1a7244c8a9e34ebd8646c001 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:42.836735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:42.933238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92686d3-006d-4f77-a753-e8496f886842 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:42.966789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e00ee-2291-41bc-bc12-1956567cbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:42.967442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e00ee-2291-41bc-bc12-1956567cbc6f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:42.967766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e00ee-2291-41bc-bc12-1956567cbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:42.968040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e00ee-2291-41bc-bc12-1956567cbc6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:42.968857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e00ee-2291-41bc-bc12-1956567cbc6f None admin] RBAC: Adding query filter params (role.id=5656ec6c481b4cdf9cefe78698198023, scope.project.id=c26a65af1a7244c8a9e34ebd8646c001, user.id=d9205c8ea0764da789bae09aff5b2685) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:42.969168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e00ee-2291-41bc-bc12-1956567cbc6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:42.970607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e00ee-2291-41bc-bc12-1956567cbc6f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:42.976266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 582/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:42 2022] GET /identity/v3/role_assignments?user.id=d9205c8ea0764da789bae09aff5b2685&scope.project.id=c26a65af1a7244c8a9e34ebd8646c001&role.id=5656ec6c481b4cdf9cefe78698198023 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:45.221529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0277648-c7da-415a-a179-5ceb0ec33fc8 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:45.222061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0277648-c7da-415a-a179-5ceb0ec33fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:45.222061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0277648-c7da-415a-a179-5ceb0ec33fc8 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:45.223420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 549/1131] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:45.228644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50ed4-4452-4cba-b04f-b84395e683c0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:45.229045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50ed4-4452-4cba-b04f-b84395e683c0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:45.229718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50ed4-4452-4cba-b04f-b84395e683c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:45.246495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-12e50ed4-4452-4cba-b04f-b84395e683c0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:45.247701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-12e50ed4-4452-4cba-b04f-b84395e683c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:45.313687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 583/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:45.336728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0277648-c7da-415a-a179-5ceb0ec33fc8 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:45.430286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0277648-c7da-415a-a179-5ceb0ec33fc8 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:45.462177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de2b55-01ec-4177-ac05-cc7387b00657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:45.462959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2b55-01ec-4177-ac05-cc7387b00657 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:45.463293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2b55-01ec-4177-ac05-cc7387b00657 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:45.463602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2b55-01ec-4177-ac05-cc7387b00657 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:45.464789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de2b55-01ec-4177-ac05-cc7387b00657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:45.466232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de2b55-01ec-4177-ac05-cc7387b00657 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:45.467854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 550/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:45.473739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50ed4-4452-4cba-b04f-b84395e683c0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:45.570357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50ed4-4452-4cba-b04f-b84395e683c0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:45.602942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7707f3-66ae-4d00-a30c-3e60a45c08b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:45.603662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7707f3-66ae-4d00-a30c-3e60a45c08b7 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:45.604070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7707f3-66ae-4d00-a30c-3e60a45c08b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:45.604344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7707f3-66ae-4d00-a30c-3e60a45c08b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:45.605076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7707f3-66ae-4d00-a30c-3e60a45c08b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:45.606543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7707f3-66ae-4d00-a30c-3e60a45c08b7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:45.765574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 584/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:11:45 2022] POST /identity/v3/projects => generated 311 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:48.012113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4561b2-9aa9-49ed-a1be-13999b8f68c4 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:48.012618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4561b2-9aa9-49ed-a1be-13999b8f68c4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:48.012618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4561b2-9aa9-49ed-a1be-13999b8f68c4 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:48.013940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 551/1135] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:48.019172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc0451-6455-4997-9594-99ef2555d248 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:48.019616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc0451-6455-4997-9594-99ef2555d248 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:48.019764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc0451-6455-4997-9594-99ef2555d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:48.036391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0fbc0451-6455-4997-9594-99ef2555d248 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:48.037556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0fbc0451-6455-4997-9594-99ef2555d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:48.100408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 585/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:48.125782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4561b2-9aa9-49ed-a1be-13999b8f68c4 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:48.221133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4561b2-9aa9-49ed-a1be-13999b8f68c4 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:48.257264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3d2c-487e-4d3a-b53c-148ed063ffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:48.258061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3d2c-487e-4d3a-b53c-148ed063ffce None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:48.258346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3d2c-487e-4d3a-b53c-148ed063ffce None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:48.258623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3d2c-487e-4d3a-b53c-148ed063ffce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:48.259848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3d2c-487e-4d3a-b53c-148ed063ffce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:48.261536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3d2c-487e-4d3a-b53c-148ed063ffce None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:48.264911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 552/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:48.270656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc0451-6455-4997-9594-99ef2555d248 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:48.364696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc0451-6455-4997-9594-99ef2555d248 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:48.397288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4baae-e83a-4d2a-b87d-3f151ebe9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:48.397949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4baae-e83a-4d2a-b87d-3f151ebe9378 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:48.398233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4baae-e83a-4d2a-b87d-3f151ebe9378 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:48.398508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4baae-e83a-4d2a-b87d-3f151ebe9378 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:48.399204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4baae-e83a-4d2a-b87d-3f151ebe9378 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:48.400704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4baae-e83a-4d2a-b87d-3f151ebe9378 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:48.486604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 586/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:11:48 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:50.765681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb517-089b-4ed4-ae60-bd395566c70a None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:50.766175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb517-089b-4ed4-ae60-bd395566c70a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:50.766283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb517-089b-4ed4-ae60-bd395566c70a None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:50.767616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 553/1139] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:50.772738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927736-4943-42b3-b73a-bfdf4993c7bd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:50.773174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927736-4943-42b3-b73a-bfdf4993c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:50.773275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927736-4943-42b3-b73a-bfdf4993c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:50.789510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9b927736-4943-42b3-b73a-bfdf4993c7bd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:50.790674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9b927736-4943-42b3-b73a-bfdf4993c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:50.852056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 587/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:50.877800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eb517-089b-4ed4-ae60-bd395566c70a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:50.999412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eb517-089b-4ed4-ae60-bd395566c70a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:51.031309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:51.032043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:51.032326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:51.032603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:51.042237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:51.049672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:51.050832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:51.052124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 554/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:51.057455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927736-4943-42b3-b73a-bfdf4993c7bd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:51.149207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927736-4943-42b3-b73a-bfdf4993c7bd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:51.180354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:51.181001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:51.181281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:51.181582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:51.182818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:51.183121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:51.184500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:51.192091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 588/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:51.197887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:51.298151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b4bf0-156b-480a-85af-cf64a08bd3f2 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:51.329436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:51.330288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:51.330568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:51.330840 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] PATH_INFO: `/v3/users/794e675f258b48399ec29532b3765f98` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:51.343194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] RBAC: Authorizing `identity:get_user(user_id=794e675f258b48399ec29532b3765f98)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:51.344645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:51.346262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 555/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:51 2022] GET /identity/v3/users/794e675f258b48399ec29532b3765f98 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:51.352087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:51.445994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddd3f5-55bc-4827-9a2b-2a14c1677587 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:51.476654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:51.477288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:51.477571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:51.477848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:51.540394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:51.542431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:51.651434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 589/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:51.657359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:51.749819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a45c-f678-410b-a7d8-7e4fa74eab7a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:51.782222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3901e-d560-4877-8562-faacdc902391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:51.783093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3901e-d560-4877-8562-faacdc902391 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:51.783382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3901e-d560-4877-8562-faacdc902391 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:51.783698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3901e-d560-4877-8562-faacdc902391 None admin] PATH_INFO: `/v3/projects/0d79303303fd4363bfcf1951962a1b2b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:51.784935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3901e-d560-4877-8562-faacdc902391 None admin] RBAC: Authorizing `identity:get_project(project_id=0d79303303fd4363bfcf1951962a1b2b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:51.786371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3901e-d560-4877-8562-faacdc902391 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:51.788115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 556/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:51 2022] GET /identity/v3/projects/0d79303303fd4363bfcf1951962a1b2b => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:51.794963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:51.904535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d33f-b505-4069-b80a-514ac1dd0054 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:51.939745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff1b8d-0a0e-418d-a314-760baf5e397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:51.940391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff1b8d-0a0e-418d-a314-760baf5e397f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:51.940670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff1b8d-0a0e-418d-a314-760baf5e397f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:51.940941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff1b8d-0a0e-418d-a314-760baf5e397f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:51.941742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff1b8d-0a0e-418d-a314-760baf5e397f None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=0d79303303fd4363bfcf1951962a1b2b, user.id=794e675f258b48399ec29532b3765f98) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:51.942049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff1b8d-0a0e-418d-a314-760baf5e397f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:51.943498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff1b8d-0a0e-418d-a314-760baf5e397f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:51.949143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 590/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:51 2022] GET /identity/v3/role_assignments?user.id=794e675f258b48399ec29532b3765f98&scope.project.id=0d79303303fd4363bfcf1951962a1b2b&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:54.185911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598efc-8d98-42f2-87ed-f0e6d496f43e None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:54.186466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598efc-8d98-42f2-87ed-f0e6d496f43e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:54.186466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598efc-8d98-42f2-87ed-f0e6d496f43e None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:54.187840 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 557/1147] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:54.193021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23509d-bbd4-4f98-96ee-9c568dfab42d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:54.193416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23509d-bbd4-4f98-96ee-9c568dfab42d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:54.193577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23509d-bbd4-4f98-96ee-9c568dfab42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:54.210379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ed23509d-bbd4-4f98-96ee-9c568dfab42d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:54.211589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ed23509d-bbd4-4f98-96ee-9c568dfab42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:54.274833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 591/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:54.302082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598efc-8d98-42f2-87ed-f0e6d496f43e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:54.397703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598efc-8d98-42f2-87ed-f0e6d496f43e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:54.430166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:54.430946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:54.431229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:54.432141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:54.441887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:54.449356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:54.450437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:11:54.451709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 558/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:54.456735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23509d-bbd4-4f98-96ee-9c568dfab42d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:54.550427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23509d-bbd4-4f98-96ee-9c568dfab42d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:54.581400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:54.582059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:54.582340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:54.582609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:54.583339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:54.583676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:54.585027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:54.593216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 592/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:54.599249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:54.692948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b569809-4bc2-4d1a-9c0a-a56fb6e22038 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:54.724179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:54.725036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:54.725316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:54.725588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] PATH_INFO: `/v3/users/794e675f258b48399ec29532b3765f98` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:54.726754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] RBAC: Authorizing `identity:get_user(user_id=794e675f258b48399ec29532b3765f98)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:54.728200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:54.730382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 559/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:54 2022] GET /identity/v3/users/794e675f258b48399ec29532b3765f98 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:54.736644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:54.831138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def2ee-fa11-446d-a92b-855d90539e76 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:54.863444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c9e5f-c6ed-458d-a4a4-540fce514dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:54.864329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c9e5f-c6ed-458d-a4a4-540fce514dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:54.864609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c9e5f-c6ed-458d-a4a4-540fce514dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:54.864882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c9e5f-c6ed-458d-a4a4-540fce514dd0 None admin] PATH_INFO: `/v3/projects/0d79303303fd4363bfcf1951962a1b2b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:54.866040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c9e5f-c6ed-458d-a4a4-540fce514dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d79303303fd4363bfcf1951962a1b2b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:54.867497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c9e5f-c6ed-458d-a4a4-540fce514dd0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:54.869248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 593/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:54 2022] GET /identity/v3/projects/0d79303303fd4363bfcf1951962a1b2b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:54.875258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:54.968738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411de46-fdc3-4581-bac5-73c3e79411e5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:54.999152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b5c87-e9bc-4cbb-815f-c6de356b2a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:55.000049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5c87-e9bc-4cbb-815f-c6de356b2a9f None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.000328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5c87-e9bc-4cbb-815f-c6de356b2a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.000598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5c87-e9bc-4cbb-815f-c6de356b2a9f None admin] PATH_INFO: `/v3/projects/0d79303303fd4363bfcf1951962a1b2b/users/794e675f258b48399ec29532b3765f98/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.002529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b5c87-e9bc-4cbb-815f-c6de356b2a9f None admin] RBAC: Authorizing `identity:create_grant(project_id=0d79303303fd4363bfcf1951962a1b2b, user_id=794e675f258b48399ec29532b3765f98, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:55.003975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b5c87-e9bc-4cbb-815f-c6de356b2a9f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:55.094695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 560/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:11:54 2022] PUT /identity/v3/projects/0d79303303fd4363bfcf1951962a1b2b/users/794e675f258b48399ec29532b3765f98/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:11:57.325904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a13f3-199f-461f-aeaa-27410e2d448d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:57.326458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a13f3-199f-461f-aeaa-27410e2d448d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:57.326458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a13f3-199f-461f-aeaa-27410e2d448d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:57.327866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 594/1154] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:57.332943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557c8e-513c-4d8b-9656-05edc71843de None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:57.333362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557c8e-513c-4d8b-9656-05edc71843de None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:57.333505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557c8e-513c-4d8b-9656-05edc71843de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:57.351223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1a557c8e-513c-4d8b-9656-05edc71843de None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:57.352473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1a557c8e-513c-4d8b-9656-05edc71843de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:57.415063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 561/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:11:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:11:57.438734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a13f3-199f-461f-aeaa-27410e2d448d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:57.533653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a13f3-199f-461f-aeaa-27410e2d448d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:57.565025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:57.565867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:57.566144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:57.566413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:57.576440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:57.583804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:57.584723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:11:57.585600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 595/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:11:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:57.590889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a557c8e-513c-4d8b-9656-05edc71843de None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:57.683351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a557c8e-513c-4d8b-9656-05edc71843de None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:57.714990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:57.715671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:57.715954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:57.716229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:57.716958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:57.717261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:57.718603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:57.726229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 562/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:11:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:57.732104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:57.828000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b82f7d-9464-4b44-b1a9-0aaaaebe6894 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:57.859365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:57.860252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:57.860538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:57.860813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] PATH_INFO: `/v3/users/794e675f258b48399ec29532b3765f98` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:57.861987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] RBAC: Authorizing `identity:get_user(user_id=794e675f258b48399ec29532b3765f98)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:57.863422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:57.865061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 596/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:11:57 2022] GET /identity/v3/users/794e675f258b48399ec29532b3765f98 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:57.871542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:57.965469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8efa-6833-4413-bf92-e0482400170a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:57.996272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:57.996909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:57.997196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:57.997475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:58.060704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:58.062147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:58.153939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 563/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:11:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:11:58.159705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:58.253344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af76a9-ddb3-448d-adc4-5f1a7fe7790f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:58.284914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a208d7-13b4-4c0d-9f15-ee229689829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:58.285760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a208d7-13b4-4c0d-9f15-ee229689829d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:58.286043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a208d7-13b4-4c0d-9f15-ee229689829d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:58.286318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a208d7-13b4-4c0d-9f15-ee229689829d None admin] PATH_INFO: `/v3/projects/0d79303303fd4363bfcf1951962a1b2b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:58.287517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a208d7-13b4-4c0d-9f15-ee229689829d None admin] RBAC: Authorizing `identity:get_project(project_id=0d79303303fd4363bfcf1951962a1b2b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:58.288939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a208d7-13b4-4c0d-9f15-ee229689829d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:58.290636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 597/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:11:58 2022] GET /identity/v3/projects/0d79303303fd4363bfcf1951962a1b2b => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:58.296790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:58.390487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a750-a5fc-429f-870d-567ebe7c6424 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:58.421991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff2c29-0b02-460d-b432-bac0962162f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:58.422576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff2c29-0b02-460d-b432-bac0962162f7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:58.422860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff2c29-0b02-460d-b432-bac0962162f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:58.423135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff2c29-0b02-460d-b432-bac0962162f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:58.423992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff2c29-0b02-460d-b432-bac0962162f7 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=0d79303303fd4363bfcf1951962a1b2b, user.id=794e675f258b48399ec29532b3765f98) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:58.424300 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff2c29-0b02-460d-b432-bac0962162f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:58.425715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff2c29-0b02-460d-b432-bac0962162f7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:58.431815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 564/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:11:58 2022] GET /identity/v3/role_assignments?user.id=794e675f258b48399ec29532b3765f98&scope.project.id=0d79303303fd4363bfcf1951962a1b2b&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:00.659613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a5cdf-eace-4bfc-9167-989dae1fee8c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.660146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a5cdf-eace-4bfc-9167-989dae1fee8c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.660146 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a5cdf-eace-4bfc-9167-989dae1fee8c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.661529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 598/1162] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:00.666595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ed7b-6cff-4502-bd02-3d92958cdfec None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.666977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ed7b-6cff-4502-bd02-3d92958cdfec None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.667145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ed7b-6cff-4502-bd02-3d92958cdfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.683718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-fa41ed7b-6cff-4502-bd02-3d92958cdfec None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:00.684879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-fa41ed7b-6cff-4502-bd02-3d92958cdfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:00.746980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 565/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:12:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:12:00.769485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a5cdf-eace-4bfc-9167-989dae1fee8c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:00.865463 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a5cdf-eace-4bfc-9167-989dae1fee8c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:00.898070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:00.898706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.898986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.899269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.963023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:00.964441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:01.055227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 599/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:12:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:12:01.061855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ed7b-6cff-4502-bd02-3d92958cdfec None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:01.153815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ed7b-6cff-4502-bd02-3d92958cdfec None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:01.185576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6cdfe-79eb-4029-809d-5608360c5ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:01.186360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6cdfe-79eb-4029-809d-5608360c5ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:01.186641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6cdfe-79eb-4029-809d-5608360c5ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:01.186915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6cdfe-79eb-4029-809d-5608360c5ab0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:01.193438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6cdfe-79eb-4029-809d-5608360c5ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:01.194925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6cdfe-79eb-4029-809d-5608360c5ab0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-10c6cdfe-79eb-4029-809d-5608360c5ab0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:01.208457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:01.209585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:12:01.210473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 566/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:12:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:01.215759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:01.307777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4166-58db-4b49-99dd-8402d9d76bd3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:01.339128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dabe65-4c93-4b2f-9e6d-84a92bdf44b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:01.339802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dabe65-4c93-4b2f-9e6d-84a92bdf44b5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:01.340086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dabe65-4c93-4b2f-9e6d-84a92bdf44b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:01.340362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dabe65-4c93-4b2f-9e6d-84a92bdf44b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:01.341069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dabe65-4c93-4b2f-9e6d-84a92bdf44b5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:01.341376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dabe65-4c93-4b2f-9e6d-84a92bdf44b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:01.342730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dabe65-4c93-4b2f-9e6d-84a92bdf44b5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:01.349589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 600/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Thu May 5 15:12:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:03.570509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452218b-015a-42bd-a66b-28097979c301 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.571047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452218b-015a-42bd-a66b-28097979c301 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.571047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452218b-015a-42bd-a66b-28097979c301 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.572453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 567/1167] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:03.577869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551ba7-d78e-482c-9d2b-4816a66800d3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.578310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551ba7-d78e-482c-9d2b-4816a66800d3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.578428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551ba7-d78e-482c-9d2b-4816a66800d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.595506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8e551ba7-d78e-482c-9d2b-4816a66800d3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:03.596687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8e551ba7-d78e-482c-9d2b-4816a66800d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:03.663699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 601/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:12:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:12:03.687343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452218b-015a-42bd-a66b-28097979c301 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:03.796207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452218b-015a-42bd-a66b-28097979c301 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:03.829644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be092845-60f4-4574-880c-1e3342d2c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:03.830216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092845-60f4-4574-880c-1e3342d2c477 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.830497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092845-60f4-4574-880c-1e3342d2c477 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.830770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092845-60f4-4574-880c-1e3342d2c477 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.831529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be092845-60f4-4574-880c-1e3342d2c477 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:03.832881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be092845-60f4-4574-880c-1e3342d2c477 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:03.901146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 568/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Thu May 5 15:12:03 2022] POST /identity/v3/domains => generated 267 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:06.202389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29624-2244-4884-a47e-5289b93ff38a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.202968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29624-2244-4884-a47e-5289b93ff38a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.202968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29624-2244-4884-a47e-5289b93ff38a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.204336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 602/1170] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:06.209528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dcf07-353b-4961-a0ae-1817e1d1831c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.209922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dcf07-353b-4961-a0ae-1817e1d1831c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.210083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dcf07-353b-4961-a0ae-1817e1d1831c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.229489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1e3dcf07-353b-4961-a0ae-1817e1d1831c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:06.230947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1e3dcf07-353b-4961-a0ae-1817e1d1831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:06.293626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 569/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:12:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:12:06.317880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29624-2244-4884-a47e-5289b93ff38a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:06.431587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29624-2244-4884-a47e-5289b93ff38a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:06.468181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746161f-02cf-405e-a2de-e6463b7b7006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:06.468946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746161f-02cf-405e-a2de-e6463b7b7006 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.469228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746161f-02cf-405e-a2de-e6463b7b7006 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.469504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746161f-02cf-405e-a2de-e6463b7b7006 None admin] PATH_INFO: `/v3/domains/743f3095762746779a049546e8031b6f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.479585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746161f-02cf-405e-a2de-e6463b7b7006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=743f3095762746779a049546e8031b6f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:06.481049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746161f-02cf-405e-a2de-e6463b7b7006 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:06.482742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 603/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Thu May 5 15:12:06 2022] GET /identity/v3/domains/743f3095762746779a049546e8031b6f => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:06.488731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dcf07-353b-4961-a0ae-1817e1d1831c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:06.581729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dcf07-353b-4961-a0ae-1817e1d1831c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:06.613214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c7ffe-379d-4359-8dc4-2b163159e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:06.613863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7ffe-379d-4359-8dc4-2b163159e4d3 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.614151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7ffe-379d-4359-8dc4-2b163159e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.614431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7ffe-379d-4359-8dc4-2b163159e4d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.615127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c7ffe-379d-4359-8dc4-2b163159e4d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:06.616606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c7ffe-379d-4359-8dc4-2b163159e4d3 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:06.689378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 570/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:12:06 2022] POST /identity/v3/projects => generated 361 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:08.967531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643230-dbc1-4b86-846e-9fe56a67eaa9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:08.968089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643230-dbc1-4b86-846e-9fe56a67eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:08.968089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643230-dbc1-4b86-846e-9fe56a67eaa9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:08.969446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 604/1174] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:08.974568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cc552-7122-4189-aa40-275f45a45dc6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:08.974986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cc552-7122-4189-aa40-275f45a45dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:08.975106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cc552-7122-4189-aa40-275f45a45dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:08.991059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e42cc552-7122-4189-aa40-275f45a45dc6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:08.992254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e42cc552-7122-4189-aa40-275f45a45dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:09.062893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 571/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:12:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:12:09.088527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643230-dbc1-4b86-846e-9fe56a67eaa9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:09.185289 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643230-dbc1-4b86-846e-9fe56a67eaa9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:09.216739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46b992-69b4-4b79-b349-75cd6354a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:09.217600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46b992-69b4-4b79-b349-75cd6354a57e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:09.217887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46b992-69b4-4b79-b349-75cd6354a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:09.218167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46b992-69b4-4b79-b349-75cd6354a57e None admin] PATH_INFO: `/v3/domains/743f3095762746779a049546e8031b6f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:09.219344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46b992-69b4-4b79-b349-75cd6354a57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=743f3095762746779a049546e8031b6f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:09.220797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46b992-69b4-4b79-b349-75cd6354a57e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:09.222415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 605/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Thu May 5 15:12:09 2022] GET /identity/v3/domains/743f3095762746779a049546e8031b6f => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:09.229047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cc552-7122-4189-aa40-275f45a45dc6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:09.322271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cc552-7122-4189-aa40-275f45a45dc6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:09.353659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016c28-090e-4b0e-a32b-edaaeec143e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:09.354318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016c28-090e-4b0e-a32b-edaaeec143e5 None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:09.354600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016c28-090e-4b0e-a32b-edaaeec143e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:09.354871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016c28-090e-4b0e-a32b-edaaeec143e5 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:09.355604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c016c28-090e-4b0e-a32b-edaaeec143e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:09.357016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c016c28-090e-4b0e-a32b-edaaeec143e5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:09.453695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 572/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:12:09 2022] POST /identity/v3/users => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:11.918230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5f12-bacb-48df-90ce-2e5fa0e99ae1 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.918749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5f12-bacb-48df-90ce-2e5fa0e99ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.918836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5f12-bacb-48df-90ce-2e5fa0e99ae1 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.920186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 606/1178] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:11.925201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1f5bc-eca8-467c-9eec-46c454015890 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.925640 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1f5bc-eca8-467c-9eec-46c454015890 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.925752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1f5bc-eca8-467c-9eec-46c454015890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.942324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e6f1f5bc-eca8-467c-9eec-46c454015890 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:11.943507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e6f1f5bc-eca8-467c-9eec-46c454015890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:12.004748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 573/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:12:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:12:12.028112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5f12-bacb-48df-90ce-2e5fa0e99ae1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.124665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5f12-bacb-48df-90ce-2e5fa0e99ae1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.155655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.156438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.156716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.156989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.167298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:12.174927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:12.176135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:12:12.177054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 607/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:12.183025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1f5bc-eca8-467c-9eec-46c454015890 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.274543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1f5bc-eca8-467c-9eec-46c454015890 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.307316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.307995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.308279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.308555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.309285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:12.309588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.310945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.318552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 574/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.324254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.416511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce2584-7572-46c4-b0cb-69c01238fd25 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.447349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.448224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.448503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.448775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] PATH_INFO: `/v3/users/ae21cd29bd774df485fdc231e9ad2f0f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.460941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=ae21cd29bd774df485fdc231e9ad2f0f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.462435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.464085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 608/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/users/ae21cd29bd774df485fdc231e9ad2f0f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.469756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.576880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42719c7-b39a-49d2-99a1-046d81c85109 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.607816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.608446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.608723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.608993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.673948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.675392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.766786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 575/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:12:12.772546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.865863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f3916-648a-438d-a235-426bfc42bbb6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.898566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a097cc-c501-4d72-abc3-2c221d32eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.900048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a097cc-c501-4d72-abc3-2c221d32eb3a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.900314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a097cc-c501-4d72-abc3-2c221d32eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.900589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a097cc-c501-4d72-abc3-2c221d32eb3a None admin] PATH_INFO: `/v3/projects/4d843047df584ff99574821521ecc962` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.901757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a097cc-c501-4d72-abc3-2c221d32eb3a None admin] RBAC: Authorizing `identity:get_project(project_id=4d843047df584ff99574821521ecc962)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.903185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a097cc-c501-4d72-abc3-2c221d32eb3a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.904885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 609/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/projects/4d843047df584ff99574821521ecc962 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.910899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:13.000764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f036b-9011-4b90-9469-99418dac515e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:13.032948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6b6d-fe06-40e4-905b-0d72828dfb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:13.033584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6b6d-fe06-40e4-905b-0d72828dfb67 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:13.033865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6b6d-fe06-40e4-905b-0d72828dfb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:13.034136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6b6d-fe06-40e4-905b-0d72828dfb67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.034950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6b6d-fe06-40e4-905b-0d72828dfb67 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=4d843047df584ff99574821521ecc962, user.id=ae21cd29bd774df485fdc231e9ad2f0f) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:13.035255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6b6d-fe06-40e4-905b-0d72828dfb67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.036686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6b6d-fe06-40e4-905b-0d72828dfb67 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.041847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 576/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/role_assignments?user.id=ae21cd29bd774df485fdc231e9ad2f0f&scope.project.id=4d843047df584ff99574821521ecc962&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:15.271233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0266e-050b-42bc-b8f6-3b8d05f1a9f8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.271824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0266e-050b-42bc-b8f6-3b8d05f1a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.271824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0266e-050b-42bc-b8f6-3b8d05f1a9f8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.273163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 610/1186] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:15.279039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7575a9-7d43-4ab1-a9bb-29b2b26faf40 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.279423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7575a9-7d43-4ab1-a9bb-29b2b26faf40 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.279651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7575a9-7d43-4ab1-a9bb-29b2b26faf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.296310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-cb7575a9-7d43-4ab1-a9bb-29b2b26faf40 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:15.297495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cb7575a9-7d43-4ab1-a9bb-29b2b26faf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:15.361543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 577/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:12:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:12:15.384809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0266e-050b-42bc-b8f6-3b8d05f1a9f8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.478306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0266e-050b-42bc-b8f6-3b8d05f1a9f8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.509818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.510586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.510862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.511126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.520535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:15.528434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:15.529542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:12:15.530658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 611/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:15.535641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7575a9-7d43-4ab1-a9bb-29b2b26faf40 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.630560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7575a9-7d43-4ab1-a9bb-29b2b26faf40 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.662242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.662897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.663177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.663448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.664209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:15.664531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.665880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.673403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 578/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:15.679458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.784225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5291d-0bfc-47c4-9722-8ea4afdcbb98 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.816330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.817198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.817477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.817753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] PATH_INFO: `/v3/users/ae21cd29bd774df485fdc231e9ad2f0f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.818910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] RBAC: Authorizing `identity:get_user(user_id=ae21cd29bd774df485fdc231e9ad2f0f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.820355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.822687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 612/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:12:15 2022] GET /identity/v3/users/ae21cd29bd774df485fdc231e9ad2f0f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:15.829114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.923913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deb80d-a4e2-4356-868e-65081d157e45 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.955429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032fa20-2061-429b-bc0f-c701d973bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.956303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032fa20-2061-429b-bc0f-c701d973bab5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.956590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032fa20-2061-429b-bc0f-c701d973bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.956869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032fa20-2061-429b-bc0f-c701d973bab5 None admin] PATH_INFO: `/v3/projects/4d843047df584ff99574821521ecc962` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.958037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032fa20-2061-429b-bc0f-c701d973bab5 None admin] RBAC: Authorizing `identity:get_project(project_id=4d843047df584ff99574821521ecc962)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.959461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032fa20-2061-429b-bc0f-c701d973bab5 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.961280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 579/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:12:15 2022] GET /identity/v3/projects/4d843047df584ff99574821521ecc962 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:15.967695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:16.059880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b233-39d1-4e2b-943f-f448796aae1d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:16.091452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f541b7-53cb-4a52-bd33-5f254a420ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:16.092349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f541b7-53cb-4a52-bd33-5f254a420ffa None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:16.092629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f541b7-53cb-4a52-bd33-5f254a420ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:16.092904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f541b7-53cb-4a52-bd33-5f254a420ffa None admin] PATH_INFO: `/v3/projects/4d843047df584ff99574821521ecc962/users/ae21cd29bd774df485fdc231e9ad2f0f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:16.094824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f541b7-53cb-4a52-bd33-5f254a420ffa None admin] RBAC: Authorizing `identity:create_grant(project_id=4d843047df584ff99574821521ecc962, user_id=ae21cd29bd774df485fdc231e9ad2f0f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:16.096276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f541b7-53cb-4a52-bd33-5f254a420ffa None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:16.167111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 613/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:12:15 2022] PUT /identity/v3/projects/4d843047df584ff99574821521ecc962/users/ae21cd29bd774df485fdc231e9ad2f0f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:18.429784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743004c-98e8-4da7-a9dc-4743abac2c9e None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.430853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743004c-98e8-4da7-a9dc-4743abac2c9e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.430941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743004c-98e8-4da7-a9dc-4743abac2c9e None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.432336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 580/1193] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:18.438476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fd289-633d-47d6-9a28-7f09f7b2b336 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.438881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fd289-633d-47d6-9a28-7f09f7b2b336 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.439026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fd289-633d-47d6-9a28-7f09f7b2b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.456431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-428fd289-633d-47d6-9a28-7f09f7b2b336 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:18.457624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-428fd289-633d-47d6-9a28-7f09f7b2b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:18.533250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 614/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:12:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:12:18.560767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743004c-98e8-4da7-a9dc-4743abac2c9e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.667934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743004c-98e8-4da7-a9dc-4743abac2c9e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.699786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.700503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.700783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.701055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.712369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:18.730093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:18.731277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:12:18.732215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 581/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:18.737466 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fd289-633d-47d6-9a28-7f09f7b2b336 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.838580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fd289-633d-47d6-9a28-7f09f7b2b336 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.872541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.873202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.873484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.873755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.874488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:18.874792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.876222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.885133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 615/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:18.891106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.993521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b5d2-36f4-4276-92eb-296027c471cc None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.031248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.032148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.032425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.032696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] PATH_INFO: `/v3/users/ae21cd29bd774df485fdc231e9ad2f0f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.034952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] RBAC: Authorizing `identity:get_user(user_id=ae21cd29bd774df485fdc231e9ad2f0f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.036734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.039517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 582/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/users/ae21cd29bd774df485fdc231e9ad2f0f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:19.045151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.145318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddeeb4-fcd0-43a1-bf05-e35fc8f95a99 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.179441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.188203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.188554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.188842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.265807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.267186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.358795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 616/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:12:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:12:19.364808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.457839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68749-3bf8-4b99-b3c9-70d55b2ebf1c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.488472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea35be-4663-4e36-8e2e-6ab903cd221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.489316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea35be-4663-4e36-8e2e-6ab903cd221b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.489594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea35be-4663-4e36-8e2e-6ab903cd221b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.489864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea35be-4663-4e36-8e2e-6ab903cd221b None admin] PATH_INFO: `/v3/projects/4d843047df584ff99574821521ecc962` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.491019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea35be-4663-4e36-8e2e-6ab903cd221b None admin] RBAC: Authorizing `identity:get_project(project_id=4d843047df584ff99574821521ecc962)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.493044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea35be-4663-4e36-8e2e-6ab903cd221b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.494775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 583/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Thu May 5 15:12:19 2022] GET /identity/v3/projects/4d843047df584ff99574821521ecc962 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:19.502244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.598042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d7193-cbd8-4ab4-9b9c-d870385affc1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.630780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f614-01dd-4047-a5cd-15c7fdd5b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.631431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f614-01dd-4047-a5cd-15c7fdd5b2bc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.631743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f614-01dd-4047-a5cd-15c7fdd5b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.632015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f614-01dd-4047-a5cd-15c7fdd5b2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.632831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f614-01dd-4047-a5cd-15c7fdd5b2bc None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=4d843047df584ff99574821521ecc962, user.id=ae21cd29bd774df485fdc231e9ad2f0f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:19.633163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f614-01dd-4047-a5cd-15c7fdd5b2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.634991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f614-01dd-4047-a5cd-15c7fdd5b2bc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.641017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 617/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:12:19 2022] GET /identity/v3/role_assignments?user.id=ae21cd29bd774df485fdc231e9ad2f0f&scope.project.id=4d843047df584ff99574821521ecc962&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:44.065551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ca8d1-1ae6-4f62-8005-aaae8b907f3d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.067931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ca8d1-1ae6-4f62-8005-aaae8b907f3d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.067931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ca8d1-1ae6-4f62-8005-aaae8b907f3d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.068150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 584/1201] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:44.073325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b0c0-77e3-4ddd-a738-6d6bdcbab13a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.073776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b0c0-77e3-4ddd-a738-6d6bdcbab13a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.073940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b0c0-77e3-4ddd-a738-6d6bdcbab13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.092450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4b54b0c0-77e3-4ddd-a738-6d6bdcbab13a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:44.093841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4b54b0c0-77e3-4ddd-a738-6d6bdcbab13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:44.165690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 618/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:13:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:44.190845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ca8d1-1ae6-4f62-8005-aaae8b907f3d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:44.288974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ca8d1-1ae6-4f62-8005-aaae8b907f3d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:44.321813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:44.322544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.322833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.323114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.332930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:44.334435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:44.351790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:44.352926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:44.353975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:44.353975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:44.353975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:44.353975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:13:44.353975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 585/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:44.359067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54b0c0-77e3-4ddd-a738-6d6bdcbab13a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:44.453097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54b0c0-77e3-4ddd-a738-6d6bdcbab13a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:44.485966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeffc4-1416-4b3c-a3c3-1b8fab9b458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:44.486624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeffc4-1416-4b3c-a3c3-1b8fab9b458b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.486902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeffc4-1416-4b3c-a3c3-1b8fab9b458b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.487174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeffc4-1416-4b3c-a3c3-1b8fab9b458b None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.487956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeffc4-1416-4b3c-a3c3-1b8fab9b458b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:44.488258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeffc4-1416-4b3c-a3c3-1b8fab9b458b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:44.490176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeffc4-1416-4b3c-a3c3-1b8fab9b458b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:44.501141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 619/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:44.507242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:44.602734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb26be-e79a-4293-90c0-b2a42c6e9e70 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:44.635065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b3658-0c43-4ab5-9529-1f360110e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:44.636143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3658-0c43-4ab5-9529-1f360110e48e None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.636143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3658-0c43-4ab5-9529-1f360110e48e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.636404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3658-0c43-4ab5-9529-1f360110e48e None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.637105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b3658-0c43-4ab5-9529-1f360110e48e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:44.638526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b3658-0c43-4ab5-9529-1f360110e48e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:44.712223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 586/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Thu May 5 15:13:44 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:47.001534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3e82-613b-42c9-9bc5-1051092c8fe2 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.002095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3e82-613b-42c9-9bc5-1051092c8fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.002095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3e82-613b-42c9-9bc5-1051092c8fe2 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.003543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 620/1206] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:47.009364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fca8-2de8-4d3f-852b-ac5288c7a0bd None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.009762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fca8-2de8-4d3f-852b-ac5288c7a0bd None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.009933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fca8-2de8-4d3f-852b-ac5288c7a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.026193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e0c1fca8-2de8-4d3f-852b-ac5288c7a0bd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:47.027381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e0c1fca8-2de8-4d3f-852b-ac5288c7a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:47.093542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 587/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:13:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:47.117000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d3e82-613b-42c9-9bc5-1051092c8fe2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.216425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d3e82-613b-42c9-9bc5-1051092c8fe2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.250481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.251269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.251579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.251855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.262125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:47.269579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:47.271361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:47.272281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 621/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:47.277464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1fca8-2de8-4d3f-852b-ac5288c7a0bd None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.370873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1fca8-2de8-4d3f-852b-ac5288c7a0bd None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.404324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.404985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.405266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.405541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.406279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.406585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.407971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.415694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 588/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.421486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.515891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616729-4e3b-4c03-a48e-63e4bdb7901c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.547423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.554590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.554590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.554590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.558819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.560265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:47.577413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:47.578528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:47.579933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:47.579933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:47.579933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:47.579933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:47.579933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 622/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:47.585023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.684487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c522-5635-41d8-8a43-944631fce151 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.717350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.718012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.718302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.718595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.719302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.719644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.721012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.732363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 589/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.738124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.835803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f467d3d-f632-4d2b-b7a0-9f39a0a48ede None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.868974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.869764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.870042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.870313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.877641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.879058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:47.893604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:47.894742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:47.895821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 623/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:47.900979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.008205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971316bf-53fe-44da-83ce-f511cbeee9e6 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.039833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.040588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.040794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.041065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.041887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:48.042193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.043646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.060745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 590/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:48.066526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.163217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d647c28-489f-4b34-9945-15d3fc64213f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.196300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.196945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.197237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.197514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.262243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.263734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.357619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 624/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:13:48.364888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.460759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc482ff3-90b2-4f4a-b07f-aab74cca214c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.493009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.493792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.494075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.494352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.504100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.506432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:48.523803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:48.524904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:48.526179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:48.526179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:48.526179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:48.526179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:13:48.526179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 591/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:48.531320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.625998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f54ee-7fd5-4671-9a79-4faad3c2bbb5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.658386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.659109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.659390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.659682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.660382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:48.660681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.662088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.673075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 625/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:48.679448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.777086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8af6-55d2-4b5d-842d-0d5e95009a5c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.810374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.811170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.811455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.811763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.821633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.823090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:48.836813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:48.837881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:13:48.839019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 592/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:48.844028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.941377 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8b71e-0277-44b1-9dc2-05cdca3476cf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.974951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b1485-ebb6-4797-8d86-b8dd52ce5e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.975638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1485-ebb6-4797-8d86-b8dd52ce5e17 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.975950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1485-ebb6-4797-8d86-b8dd52ce5e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.976223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1485-ebb6-4797-8d86-b8dd52ce5e17 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.976992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1485-ebb6-4797-8d86-b8dd52ce5e17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:48.977298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1485-ebb6-4797-8d86-b8dd52ce5e17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.978709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1485-ebb6-4797-8d86-b8dd52ce5e17 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.990831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 626/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:48.996943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:49.092789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b0a7d-27b6-4c73-bcee-14e9c067f676 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:49.125376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a991f0-8e6f-4a3c-8164-c32101149baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:49.126033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a991f0-8e6f-4a3c-8164-c32101149baa None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:49.126321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a991f0-8e6f-4a3c-8164-c32101149baa None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:49.126605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a991f0-8e6f-4a3c-8164-c32101149baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:49.127434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a991f0-8e6f-4a3c-8164-c32101149baa None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=4b8520e6db2346c59a1230380c515703) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:49.127786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a991f0-8e6f-4a3c-8164-c32101149baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:49.129214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a991f0-8e6f-4a3c-8164-c32101149baa None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:49.134745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 593/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/role_assignments?user.id=4b8520e6db2346c59a1230380c515703&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:51.373147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e871315-2f32-4d07-a718-9993006b4932 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.373739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e871315-2f32-4d07-a718-9993006b4932 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.373739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e871315-2f32-4d07-a718-9993006b4932 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.375089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 627/1220] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:51.380553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded094c-b697-4d71-87f2-1b1176ef44c5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.381285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded094c-b697-4d71-87f2-1b1176ef44c5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.381418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded094c-b697-4d71-87f2-1b1176ef44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.397891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-dded094c-b697-4d71-87f2-1b1176ef44c5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:51.399088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-dded094c-b697-4d71-87f2-1b1176ef44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:51.466195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 594/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:13:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:51.489629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e871315-2f32-4d07-a718-9993006b4932 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:51.596808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e871315-2f32-4d07-a718-9993006b4932 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:51.629826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:51.630586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.631123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.631397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.641169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:51.649272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:51.650219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:51.651089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 628/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:51.656757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded094c-b697-4d71-87f2-1b1176ef44c5 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:51.754197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded094c-b697-4d71-87f2-1b1176ef44c5 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:51.788219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:51.788888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.789170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.789446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.790188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:51.790491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:51.791881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:51.800041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 595/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:51.806334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:51.917315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c270-3630-425b-b230-6012702ae558 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:51.949576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:51.950438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.950724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.951003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.962101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:51.963600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:51.980935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:51.984841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:51.985983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:51.985983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:51.985983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:51.985983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:51.985983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 629/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:51.988184 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.086457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348ed3-0f9f-4ca9-a472-bb295e5a7d71 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.121115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.121858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.122147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.122428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.123225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:52.123566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.125007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.138367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 596/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:52.144378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.240402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ba28-a119-439f-9793-6d8a75324ec9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.273134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.273971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.274256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.274524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.282809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.284279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:52.298207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:52.303737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:52.305115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 630/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:52.305951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.401276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c30c-5e2a-4a8d-8184-87382d03f0b0 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.433844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.434581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.434863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.435142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.436016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:52.436349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.437761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.455037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 597/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:52.460947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.556662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbf30-7043-4198-b6d9-a5ab2eb21e2b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.589558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.590340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.590617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.590889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.601364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.602817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:52.619747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:52.620880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:52.621803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:52.621803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:52.621803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:52.621803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:52.621803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 631/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:52.626704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.721608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475109-2a18-49f9-9ea4-ca2a39843258 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.756437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.756891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.757173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.757452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.758180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:52.758486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.759876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.771121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 598/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:52.777059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.873088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbde42-17f8-4cbe-92ae-9c1fb9971635 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.906485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.907272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.907585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.907859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.914787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.916242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:52.930381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:52.932024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:52.933237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 632/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:52.937428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.032646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e28f1-eafb-4b7e-882c-e3dfd081e1d9 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.065836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c31c2-d266-4d1a-b979-15f22c671330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.066508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c31c2-d266-4d1a-b979-15f22c671330 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.066798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c31c2-d266-4d1a-b979-15f22c671330 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.067731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c31c2-d266-4d1a-b979-15f22c671330 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.068533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c31c2-d266-4d1a-b979-15f22c671330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.068849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c31c2-d266-4d1a-b979-15f22c671330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.070349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c31c2-d266-4d1a-b979-15f22c671330 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.082284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 599/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:53.088421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.183871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd8875-cb0b-4615-a89a-09ea4325bc96 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.216855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43a881-bbb7-4fd0-9dbe-fd2c93d12186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.217725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43a881-bbb7-4fd0-9dbe-fd2c93d12186 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.218001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43a881-bbb7-4fd0-9dbe-fd2c93d12186 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.218269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43a881-bbb7-4fd0-9dbe-fd2c93d12186 None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/4b8520e6db2346c59a1230380c515703/roles/572a3d7ebad94e73ac07b1b30d647dfa` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.231727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43a881-bbb7-4fd0-9dbe-fd2c93d12186 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=4b8520e6db2346c59a1230380c515703, role_id=572a3d7ebad94e73ac07b1b30d647dfa)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.234331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43a881-bbb7-4fd0-9dbe-fd2c93d12186 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.318700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 633/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:13:53 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/4b8520e6db2346c59a1230380c515703/roles/572a3d7ebad94e73ac07b1b30d647dfa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:55.519489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9472-e16c-4c48-a87a-57b39fda190f None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:55.520562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9472-e16c-4c48-a87a-57b39fda190f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:55.520562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9472-e16c-4c48-a87a-57b39fda190f None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:55.521897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 600/1233] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:55.527091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d487-8328-40f8-8a3d-192436bbe4db None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:55.528548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d487-8328-40f8-8a3d-192436bbe4db None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:55.528548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d487-8328-40f8-8a3d-192436bbe4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:55.547023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2f51d487-8328-40f8-8a3d-192436bbe4db None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:55.548268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2f51d487-8328-40f8-8a3d-192436bbe4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:55.618506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 634/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:13:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:55.642187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad9472-e16c-4c48-a87a-57b39fda190f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:55.739590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad9472-e16c-4c48-a87a-57b39fda190f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:55.778480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:55.779312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:55.779501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:55.779779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:55.789436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:55.796953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:55.798086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:13:55.799130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 601/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Thu May 5 15:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:55.804158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51d487-8328-40f8-8a3d-192436bbe4db None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:55.903714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51d487-8328-40f8-8a3d-192436bbe4db None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:55.938059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:55.938761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:55.939040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:55.939313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:55.940082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:55.940387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:55.941756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:55.949962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 635/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Thu May 5 15:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:55.955682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.049930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e9f1e-695a-47ef-ac75-c14a462830c5 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.082059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.086305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.086305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.086305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.093670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.095131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:56.111220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:56.115034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:56.116198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:56.116198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:56.116198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:56.116198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:13:56.116198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 602/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:56.118870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.211810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8d207-fe44-4770-aee1-767cd1c75a8c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.245242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.245900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.246180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.246448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.247150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:56.247452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.248836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.261038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 636/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:56.267307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.360943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddb0fb-38de-4fb1-9d54-d7c40a5e3712 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.392545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.393329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.393609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.393880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.400949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.402369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:56.416501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:56.417458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:13:56.418439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 603/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:56.423490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.517827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee815fe-d222-4aa2-a76e-a76804eb9d32 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.558187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.558870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.559129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.559492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.560479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:56.560792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.562252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.585613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 637/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:56.591895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.695053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be415f7d-0f02-438c-84a5-8ab941b9cb77 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.726925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.727588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.727870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.728144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.792686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.797196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.886682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 604/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:13:56.892399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.991175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950c375-1f69-48ed-b66a-5e66c5b46d0c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.023307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.024118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.024400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.024674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.034158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.035671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:57.053171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:57.054201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:57.055148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:57.055148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:57.055148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:57.055148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:57.055148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 638/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:57.060244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.155387 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ded0ec-dcf6-4bc8-b08d-12c08fd8df4f None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.187588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.188248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.188531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.188806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.189519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.189825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.191179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.202481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 605/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.208786 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.304766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576db09-17ce-45f3-89f6-31425299497f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.338008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.338791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.339064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.339337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.345736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.347168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:57.360242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:57.361266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:13:57.362338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 639/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:57.367393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.461480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe13ee-ba1c-44d4-94d0-41d40fa0599a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.492895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e35fd-39d7-481e-ac1e-6fa7a4c252fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.493578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e35fd-39d7-481e-ac1e-6fa7a4c252fc None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.493866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e35fd-39d7-481e-ac1e-6fa7a4c252fc None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.494139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e35fd-39d7-481e-ac1e-6fa7a4c252fc None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.494911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e35fd-39d7-481e-ac1e-6fa7a4c252fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.495217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e35fd-39d7-481e-ac1e-6fa7a4c252fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.496653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e35fd-39d7-481e-ac1e-6fa7a4c252fc None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.508848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 606/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.515016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.610045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc374d0-f26b-417f-a124-af7af48fcc8e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.643154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ccf9b-9a10-4b17-885d-739be98f8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.643844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ccf9b-9a10-4b17-885d-739be98f8366 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.644129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ccf9b-9a10-4b17-885d-739be98f8366 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.644404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ccf9b-9a10-4b17-885d-739be98f8366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.645227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ccf9b-9a10-4b17-885d-739be98f8366 None admin] RBAC: Adding query filter params (role.id=572a3d7ebad94e73ac07b1b30d647dfa, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=4b8520e6db2346c59a1230380c515703) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.645535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ccf9b-9a10-4b17-885d-739be98f8366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.646948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ccf9b-9a10-4b17-885d-739be98f8366 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.652646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 640/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/role_assignments?user.id=4b8520e6db2346c59a1230380c515703&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=572a3d7ebad94e73ac07b1b30d647dfa => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:59.936816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4b145-94b1-4d32-9769-e1eec310b1d9 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:59.937366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4b145-94b1-4d32-9769-e1eec310b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:59.937366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4b145-94b1-4d32-9769-e1eec310b1d9 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:59.938754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 607/1247] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:59.944019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6d4e-a262-441f-a1d2-77d5f4d2d320 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:59.944435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6d4e-a262-441f-a1d2-77d5f4d2d320 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:59.944624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6d4e-a262-441f-a1d2-77d5f4d2d320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:59.960876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0e3e6d4e-a262-441f-a1d2-77d5f4d2d320 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:59.962081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0e3e6d4e-a262-441f-a1d2-77d5f4d2d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:00.025363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 641/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:13:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:00.048231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4b145-94b1-4d32-9769-e1eec310b1d9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.145572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4b145-94b1-4d32-9769-e1eec310b1d9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.178091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.178910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.179199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.179503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.189544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:00.197236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:00.202596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:00.203746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 608/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:00.204660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e6d4e-a262-441f-a1d2-77d5f4d2d320 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.299315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e6d4e-a262-441f-a1d2-77d5f4d2d320 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.331757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.332418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.333211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.333486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.334235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:00.334537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.335923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.343807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 642/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:00.350294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.448680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd785-33a2-4c90-ae9d-f5e35df7f6cf None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.480548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.481331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.481609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.481879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.491829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.493268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:00.510324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:00.511321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:00.512266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:00.512266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:00.512266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:00.512266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:00.512266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 609/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:00.517329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.621905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5433c27-c0fd-45a4-bb2a-4c8a539fb989 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.658061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.658742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.659025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.659300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.660060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:00.660371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.661859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.674813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 643/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:00.680480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.780179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328affa3-0323-429e-ae74-8355ba7dd024 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.812110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.812909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.813187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.813462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.822412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.823909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:00.838583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:00.839646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:00.840891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 610/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:00.845599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.942610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35ecd-f2e2-4420-a732-b722f3a61738 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.977789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.978494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.978777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.979054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.979915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:00.980223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.981651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.000197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 644/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:01.006940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.103781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22640ef-59d3-4c72-ba84-76c0d29b607a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.137696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.138356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.138656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.139003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.204806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.206177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.303935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 611/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:01.309858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.408037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178c46-f5bd-46ff-993b-5c9c59bf4f87 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.441293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.442141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.442419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.442688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.452323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.453824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:01.473688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:01.474813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:01.475980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:01.475980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:01.475980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:01.475980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:01.475980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 645/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:01.478584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.576234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed894-54fb-4a7e-86c6-556da0029106 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.610415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.611074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.611356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.611658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.612377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:01.612680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.614716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.626325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 612/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:01.632650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.732271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10551118-a21e-469d-9897-d2e60be27c9c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.775762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.776995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.777507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.777825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.791567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.794306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:01.818950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:01.820035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:01.822759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 646/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:01.830750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.940023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72f0c6-e014-4d50-9893-12a620c6fc50 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.975379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636453a-2e39-4f91-b859-eb69847eba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.976078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636453a-2e39-4f91-b859-eb69847eba16 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.976356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636453a-2e39-4f91-b859-eb69847eba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.976624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636453a-2e39-4f91-b859-eb69847eba16 None admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.977416 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636453a-2e39-4f91-b859-eb69847eba16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:01.977726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636453a-2e39-4f91-b859-eb69847eba16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.979191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636453a-2e39-4f91-b859-eb69847eba16 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.991878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 613/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:01.997476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:02.097431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222dd42-0c8e-4313-9ff5-ecc94c2d5237 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:02.131599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778efe5e-1d30-49b0-b67d-4439cf1fe3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:02.132257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efe5e-1d30-49b0-b67d-4439cf1fe3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:02.132536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efe5e-1d30-49b0-b67d-4439cf1fe3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:02.132809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efe5e-1d30-49b0-b67d-4439cf1fe3b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:02.133626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778efe5e-1d30-49b0-b67d-4439cf1fe3b7 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=4b8520e6db2346c59a1230380c515703) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:02.133935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778efe5e-1d30-49b0-b67d-4439cf1fe3b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:02.135349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778efe5e-1d30-49b0-b67d-4439cf1fe3b7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:02.141018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 647/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/role_assignments?user.id=4b8520e6db2346c59a1230380c515703&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:04.342308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1d1a6-b107-4101-bc93-cce179dd27fe None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.342874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1d1a6-b107-4101-bc93-cce179dd27fe None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.342874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1d1a6-b107-4101-bc93-cce179dd27fe None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.344234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 614/1261] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:04.350295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b5543-aa77-43c1-a594-56cf1c6e3233 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.350793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b5543-aa77-43c1-a594-56cf1c6e3233 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.350874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b5543-aa77-43c1-a594-56cf1c6e3233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.368041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-866b5543-aa77-43c1-a594-56cf1c6e3233 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:04.369235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-866b5543-aa77-43c1-a594-56cf1c6e3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:04.436667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 648/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:14:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:04.459290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1d1a6-b107-4101-bc93-cce179dd27fe None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.559925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1d1a6-b107-4101-bc93-cce179dd27fe None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.593415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.594156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.594437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.594709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.607101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:04.615342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:04.616515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:04.617672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 615/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:04.622851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b5543-aa77-43c1-a594-56cf1c6e3233 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.729399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b5543-aa77-43c1-a594-56cf1c6e3233 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.763931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.764603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.764881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.765158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.765900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:04.766204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.767685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.776544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 649/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:04.782234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.879449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6326fc-5a60-4813-9252-a948aba23f5c None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.913580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.914375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.914657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.914931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.925568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.927085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:04.943956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:04.953346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:04.954402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:04.954402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:04.954402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:04.954402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:04.954402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 616/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:04.954774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:05.059195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88bcdc-8453-4265-a33c-b280be1b3038 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:05.092442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:05.093110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.093443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.093718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.094433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:05.094740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:05.096144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:05.107800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 650/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:05.113632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:05.214360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a552cd7-8aa9-499e-86b0-b9b80e1b66b8 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:05.246271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:05.247101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.247412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.247698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.257062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:05.258605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:05.274070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:05.275913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:05.278006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 617/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:05.282866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:05.377514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233b411-8726-4a22-abb6-a9b57af66922 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:05.411074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:05.411773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.412061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.412326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.413145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:05.413449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:05.414861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:05.432123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 651/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Thu May 5 15:14:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:05.437911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:05.538223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520f58-53f6-4637-98d5-75517359f9ff None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:05.573181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:05.573971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.574251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.574521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.584955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:05.586349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:05.602859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:05.603887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:05.604814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:05.604814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:05.604814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:05.604814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:05.604814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 618/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:05.610083 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:05.706164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956cca3-54be-4ab0-ae66-b17c598f2559 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:05.740090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:05.740756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.741034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.741307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.742016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:05.742326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:05.743716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:05.756392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 652/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:05.762037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:05.860479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecbc3b-ca2c-4d4e-bbed-ec95af506ec2 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:05.894739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:05.895722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.896004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.896281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.902966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:05.904530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:05.919985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:05.922273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:05.923289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 619/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:05.927612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.027905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a121e2-b470-4f53-a723-7c7756f7384a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.061843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9738427-0b2d-46ba-b399-9acabfbcec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.062506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738427-0b2d-46ba-b399-9acabfbcec0b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.062793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738427-0b2d-46ba-b399-9acabfbcec0b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.063072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738427-0b2d-46ba-b399-9acabfbcec0b None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.063882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9738427-0b2d-46ba-b399-9acabfbcec0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:06.064197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9738427-0b2d-46ba-b399-9acabfbcec0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.065631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9738427-0b2d-46ba-b399-9acabfbcec0b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.077648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 653/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:06.083838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.181089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b515c8-e8a3-411e-a508-a3487457c2f7 None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.213750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3f8a2-c105-440d-ba98-e25ba82dd5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.214644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3f8a2-c105-440d-ba98-e25ba82dd5ac None admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.214929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3f8a2-c105-440d-ba98-e25ba82dd5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.215211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3f8a2-c105-440d-ba98-e25ba82dd5ac None admin] PATH_INFO: `/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/4b8520e6db2346c59a1230380c515703/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.217378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3f8a2-c105-440d-ba98-e25ba82dd5ac None admin] RBAC: Authorizing `identity:create_grant(project_id=82b2904f97ab480999aaefa22a0ae045, user_id=4b8520e6db2346c59a1230380c515703, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.218955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3f8a2-c105-440d-ba98-e25ba82dd5ac None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.369451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 620/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Thu May 5 15:14:06 2022] PUT /identity/v3/projects/82b2904f97ab480999aaefa22a0ae045/users/4b8520e6db2346c59a1230380c515703/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:08.619494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd014ecc-e5b9-425d-9dfb-b503c8f7655c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:08.620045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd014ecc-e5b9-425d-9dfb-b503c8f7655c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:08.620172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd014ecc-e5b9-425d-9dfb-b503c8f7655c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:08.621479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 654/1274] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:08.626755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4709e6-d07b-43ff-a019-e1a6cca52204 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:08.627241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4709e6-d07b-43ff-a019-e1a6cca52204 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:08.627360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4709e6-d07b-43ff-a019-e1a6cca52204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:08.644286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1a4709e6-d07b-43ff-a019-e1a6cca52204 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:08.646001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1a4709e6-d07b-43ff-a019-e1a6cca52204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:08.719482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 621/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:14:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:08.743750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd014ecc-e5b9-425d-9dfb-b503c8f7655c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:08.846300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd014ecc-e5b9-425d-9dfb-b503c8f7655c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:08.880956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:08.881696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:08.881955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:08.882230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:08.892371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:08.900497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:08.901554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:08.902579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 655/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Thu May 5 15:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:08.907783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4709e6-d07b-43ff-a019-e1a6cca52204 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.003678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4709e6-d07b-43ff-a019-e1a6cca52204 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.037130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93389194-35b4-4976-be97-21d83e39194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.037799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93389194-35b4-4976-be97-21d83e39194e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.038085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93389194-35b4-4976-be97-21d83e39194e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.038367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93389194-35b4-4976-be97-21d83e39194e None admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.039134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93389194-35b4-4976-be97-21d83e39194e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:09.039450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93389194-35b4-4976-be97-21d83e39194e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.040891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93389194-35b4-4976-be97-21d83e39194e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.050389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 622/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Thu May 5 15:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:09.056382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.155427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1fb7a-e098-408b-86e4-36dfc0d1941c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.187214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.188039 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.188309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.188579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.199446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.200919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:09.217314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:09.220642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:09.221775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:09.221775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:09.221775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:09.221775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:09.221775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 656/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:09.224490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93389194-35b4-4976-be97-21d83e39194e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.321570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93389194-35b4-4976-be97-21d83e39194e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.356035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.356839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.357121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.357393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.358164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:09.358469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.359860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.373052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 623/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:09.378940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.486760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af59d9-ea66-47d9-87d0-e29ab382bf5e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.520157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.520954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.521233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.521506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.529366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.543757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:09.545474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:09.546593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:09.547852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 657/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:09.553316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.655541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a0b19-f367-40b2-b2e0-48d46f77dcba None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.690990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.691714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.691996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.692272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.693103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:09.693423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.694873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.712292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 624/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:09.718087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.817220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a770b2-6399-4294-9a12-9d08138e48b0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.848632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.849267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.849550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.849826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.914288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.915858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.010264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 658/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:10.015988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:10.121542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc982f8-f812-4a33-9a9e-752dc90edd8b None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:10.153782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:10.154564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.154841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.155107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.165985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:10.167427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:10.184745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:10.185877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:10.186865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:10.186865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:10.186865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:10.186865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:10.186865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 625/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:10.191821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:10.287955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41061128-f96c-45ca-8057-0a4567284825 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:10.320391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:10.321050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.321331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.321636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.322349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:10.322653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:10.324055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.335417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 659/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Thu May 5 15:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:10.341136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:10.446627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242429-b4dd-4535-984b-77f3aa6f986a None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:10.481541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:10.482361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.482638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.482908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.490440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:10.491995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:10.507687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application with Lock( May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:10.508937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: ERROR keystone.server.flask.application May 05 15:14:10.509963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 626/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Thu May 5 15:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:10.514997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:10.614752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75b2b1-e8f2-4f82-9e22-12a6418210ec None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:10.647122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003847a-749c-4461-bb7c-086fd7ea9b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:10.647805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003847a-749c-4461-bb7c-086fd7ea9b4e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.648092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003847a-749c-4461-bb7c-086fd7ea9b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.648486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003847a-749c-4461-bb7c-086fd7ea9b4e None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.649148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003847a-749c-4461-bb7c-086fd7ea9b4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:10.649455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003847a-749c-4461-bb7c-086fd7ea9b4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:10.650866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003847a-749c-4461-bb7c-086fd7ea9b4e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.662454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 660/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Thu May 5 15:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:10.668659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:10.764374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7588c74-95f8-4d5f-b870-a9beb11d514e None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:10.797498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dbf53-21c3-455d-9375-821b6c669922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:10.798157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbf53-21c3-455d-9375-821b6c669922 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.798442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbf53-21c3-455d-9375-821b6c669922 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.798722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbf53-21c3-455d-9375-821b6c669922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.799583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbf53-21c3-455d-9375-821b6c669922 None admin] RBAC: Adding query filter params (role.id=87bed206da0e4d099e5d28c7da278f6b, scope.project.id=82b2904f97ab480999aaefa22a0ae045, user.id=4b8520e6db2346c59a1230380c515703) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:10.799891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbf53-21c3-455d-9375-821b6c669922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:10.801890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbf53-21c3-455d-9375-821b6c669922 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.810953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 627/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Thu May 5 15:14:10 2022] GET /identity/v3/role_assignments?user.id=4b8520e6db2346c59a1230380c515703&scope.project.id=82b2904f97ab480999aaefa22a0ae045&role.id=87bed206da0e4d099e5d28c7da278f6b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:13.109818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcb090-95b2-42ac-8371-aa56e04926e3 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.110376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcb090-95b2-42ac-8371-aa56e04926e3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.110471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcb090-95b2-42ac-8371-aa56e04926e3 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.111858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 661/1288] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:13.118123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd83a-6a63-43eb-a459-df6716b5fa35 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.118660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd83a-6a63-43eb-a459-df6716b5fa35 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.118660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd83a-6a63-43eb-a459-df6716b5fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.136598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3a9cd83a-6a63-43eb-a459-df6716b5fa35 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:13.138227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3a9cd83a-6a63-43eb-a459-df6716b5fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:13.204419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 628/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:14:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:13.227003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcb090-95b2-42ac-8371-aa56e04926e3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.323912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcb090-95b2-42ac-8371-aa56e04926e3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.356509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.357303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.357579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.357845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.358484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.359915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:13.371630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:13.372874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:13.373906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 662/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:13.378989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd83a-6a63-43eb-a459-df6716b5fa35 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.476394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd83a-6a63-43eb-a459-df6716b5fa35 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.510180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c3c8a-fa2e-4f91-9eaf-137a4305a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.510854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c3c8a-fa2e-4f91-9eaf-137a4305a430 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.511135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c3c8a-fa2e-4f91-9eaf-137a4305a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.511415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c3c8a-fa2e-4f91-9eaf-137a4305a430 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.512159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c3c8a-fa2e-4f91-9eaf-137a4305a430 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:13.512464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c3c8a-fa2e-4f91-9eaf-137a4305a430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.513851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c3c8a-fa2e-4f91-9eaf-137a4305a430 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.519781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 629/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:13.526322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.625709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fd2de-aee6-4505-ad8c-88058bf41ae8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.660112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50fe86-e088-4ab3-bde2-5554a5c3c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.660798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50fe86-e088-4ab3-bde2-5554a5c3c507 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.661080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50fe86-e088-4ab3-bde2-5554a5c3c507 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.661357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50fe86-e088-4ab3-bde2-5554a5c3c507 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.662056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50fe86-e088-4ab3-bde2-5554a5c3c507 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:13.662364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50fe86-e088-4ab3-bde2-5554a5c3c507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.663775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50fe86-e088-4ab3-bde2-5554a5c3c507 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.668740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 663/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:15.912283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f0ae-96ee-4a48-bb23-4bb1bb8d1be8 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.912815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f0ae-96ee-4a48-bb23-4bb1bb8d1be8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.912909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f0ae-96ee-4a48-bb23-4bb1bb8d1be8 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.914201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 630/1293] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:15.921043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a688-a41c-43f9-abff-630fc82478d0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.921479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a688-a41c-43f9-abff-630fc82478d0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.921600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a688-a41c-43f9-abff-630fc82478d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.938567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2e58a688-a41c-43f9-abff-630fc82478d0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:15.939846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2e58a688-a41c-43f9-abff-630fc82478d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:16.017955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 664/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:14:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:16.040812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0f0ae-96ee-4a48-bb23-4bb1bb8d1be8 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:16.139305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0f0ae-96ee-4a48-bb23-4bb1bb8d1be8 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:16.177383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35316a25-154f-446e-85ca-c6af9dd41eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:16.178053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316a25-154f-446e-85ca-c6af9dd41eab None admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.178339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316a25-154f-446e-85ca-c6af9dd41eab None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.178619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316a25-154f-446e-85ca-c6af9dd41eab None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.179340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35316a25-154f-446e-85ca-c6af9dd41eab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:16.180745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35316a25-154f-446e-85ca-c6af9dd41eab None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:16.267031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 631/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Thu May 5 15:14:16 2022] POST /identity/v3/services => generated 246 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:18.533201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f873-074a-42ab-9211-121527c30e17 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.533769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f873-074a-42ab-9211-121527c30e17 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.533769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f873-074a-42ab-9211-121527c30e17 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.535115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 665/1296] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:18.541159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6598-fec3-4c08-8817-460a2b3966bd None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.541925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6598-fec3-4c08-8817-460a2b3966bd None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.542091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6598-fec3-4c08-8817-460a2b3966bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.559068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9f2f6598-fec3-4c08-8817-460a2b3966bd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:18.560373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9f2f6598-fec3-4c08-8817-460a2b3966bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:18.629965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 632/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:14:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:18.652684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f873-074a-42ab-9211-121527c30e17 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.754253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f873-074a-42ab-9211-121527c30e17 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.789090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.789855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.790141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.790417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.791072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.792485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:18.804590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:18.811585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:18.812758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 666/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:18.813778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6598-fec3-4c08-8817-460a2b3966bd None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.907250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6598-fec3-4c08-8817-460a2b3966bd None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.943428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.944130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.944412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.944686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.945394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:18.945698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.947054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.952242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 633/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:18.958674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:19.053965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96feae-dc8e-4bdd-8403-03075712c0eb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:19.085577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbc177-23ab-4dd9-922a-fe9dfe17d6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:19.086234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbc177-23ab-4dd9-922a-fe9dfe17d6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.086514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbc177-23ab-4dd9-922a-fe9dfe17d6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.086784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbc177-23ab-4dd9-922a-fe9dfe17d6a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.087656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbc177-23ab-4dd9-922a-fe9dfe17d6a0 None admin] RBAC: Adding query filter params (interface=public, service_id=79d37bcf397e4a799f6bb5b429df43c0, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:19.087959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbc177-23ab-4dd9-922a-fe9dfe17d6a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:19.089322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbc177-23ab-4dd9-922a-fe9dfe17d6a0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:19.098902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 667/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/endpoints?service_id=79d37bcf397e4a799f6bb5b429df43c0&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:19.100987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:19.195375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe60c6-6492-4d70-bf1b-c4dc99e6ddcd None admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:19.229043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1833fe-9fe3-4e09-98e8-a7d816a88493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:19.229946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1833fe-9fe3-4e09-98e8-a7d816a88493 None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.230211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1833fe-9fe3-4e09-98e8-a7d816a88493 None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.230589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1833fe-9fe3-4e09-98e8-a7d816a88493 None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.231360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1833fe-9fe3-4e09-98e8-a7d816a88493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:19.232833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1833fe-9fe3-4e09-98e8-a7d816a88493 None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:19.239685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 634/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Thu May 5 15:14:19 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:14:21.490286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7015808-f413-4a24-8507-70463be0912b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.490836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7015808-f413-4a24-8507-70463be0912b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.490836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7015808-f413-4a24-8507-70463be0912b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.492255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 668/1302] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:21.497315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1ad6-7184-4a99-89cf-64ccd12e16bf None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.497743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1ad6-7184-4a99-89cf-64ccd12e16bf None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.497877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1ad6-7184-4a99-89cf-64ccd12e16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.515083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e75a1ad6-7184-4a99-89cf-64ccd12e16bf None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:21.516291 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e75a1ad6-7184-4a99-89cf-64ccd12e16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:21.583622 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 635/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:14:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:21.606529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7015808-f413-4a24-8507-70463be0912b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:21.705735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7015808-f413-4a24-8507-70463be0912b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:21.738720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:21.739592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.739872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.740144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.740842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:21.742144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:21.753898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:21.755843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: ERROR keystone.server.flask.application May 05 15:14:21.756747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 669/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Thu May 5 15:14:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:21.762070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1ad6-7184-4a99-89cf-64ccd12e16bf None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:21.854762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1ad6-7184-4a99-89cf-64ccd12e16bf None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:21.887731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b7f8f-f08f-4a80-a1f4-a2917d30749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:21.888779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7f8f-f08f-4a80-a1f4-a2917d30749d None admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.889263 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7f8f-f08f-4a80-a1f4-a2917d30749d None admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.889736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7f8f-f08f-4a80-a1f4-a2917d30749d None admin] PATH_INFO: `/v3/services` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.891004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7f8f-f08f-4a80-a1f4-a2917d30749d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:21.891584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7f8f-f08f-4a80-a1f4-a2917d30749d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:21.894070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7f8f-f08f-4a80-a1f4-a2917d30749d None admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:21.901517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 636/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Thu May 5 15:14:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:21.907216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.004823 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4fac-e436-4612-be11-0270f316b541 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.049350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1323c1-006a-4bae-8439-cac1372b1e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.050008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1323c1-006a-4bae-8439-cac1372b1e7a None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.050292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1323c1-006a-4bae-8439-cac1372b1e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.050570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1323c1-006a-4bae-8439-cac1372b1e7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.051884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1323c1-006a-4bae-8439-cac1372b1e7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.053248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1323c1-006a-4bae-8439-cac1372b1e7a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.273591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 670/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Thu May 5 15:14:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:21:30.354546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525df79-c1a5-4d17-9aa2-2f99310de520 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:30.354546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525df79-c1a5-4d17-9aa2-2f99310de520 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:30.354546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525df79-c1a5-4d17-9aa2-2f99310de520 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:30.361109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b6c6a-f138-41c1-aebc-f7094f292b4f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:30.361539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b6c6a-f138-41c1-aebc-f7094f292b4f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:30.361675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b6c6a-f138-41c1-aebc-f7094f292b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:30.364882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 637/1307] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:30.452517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d04b6c6a-f138-41c1-aebc-f7094f292b4f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:30.453745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d04b6c6a-f138-41c1-aebc-f7094f292b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:30.569656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 671/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:21:30.621357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20226eb-3000-4ba8-971f-dacad22d3000 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:30.621659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20226eb-3000-4ba8-971f-dacad22d3000 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:30.622231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20226eb-3000-4ba8-971f-dacad22d3000 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:30.624371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 638/1309] 10.222.0.55 () {54 vars in 964 bytes} [Thu May 5 15:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:30.634296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f971092-90c9-481f-a350-0dfae47ba4c4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:30.634643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f971092-90c9-481f-a350-0dfae47ba4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:30.634862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f971092-90c9-481f-a350-0dfae47ba4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:30.723126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0f971092-90c9-481f-a350-0dfae47ba4c4 None None] MFA Rules not processed for user `9c25e83af7604455bad1d7c0ee1c0122`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:30.724821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0f971092-90c9-481f-a350-0dfae47ba4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:30.819679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 672/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Thu May 5 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:30.829557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20226eb-3000-4ba8-971f-dacad22d3000 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:30.831308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a20226eb-3000-4ba8-971f-dacad22d3000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:30.961961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20226eb-3000-4ba8-971f-dacad22d3000 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:31.053418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5145e5-eb4c-44fa-9ecb-cba31f2c2936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:31.054754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5145e5-eb4c-44fa-9ecb-cba31f2c2936 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:31.055277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5145e5-eb4c-44fa-9ecb-cba31f2c2936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:31.055811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5145e5-eb4c-44fa-9ecb-cba31f2c2936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:31.059196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cd5145e5-eb4c-44fa-9ecb-cba31f2c2936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:31.218785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5145e5-eb4c-44fa-9ecb-cba31f2c2936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:31.220217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5145e5-eb4c-44fa-9ecb-cba31f2c2936 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:31.242546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 639/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:21:33.955210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677596f-aa1a-401d-bc39-7e9dd3692bd4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:33.955898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677596f-aa1a-401d-bc39-7e9dd3692bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:33.955898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677596f-aa1a-401d-bc39-7e9dd3692bd4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:33.957168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 673/1312] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:33.962564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9fdac-141c-414b-831a-dcb6f1171ee9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:33.963106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9fdac-141c-414b-831a-dcb6f1171ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:33.963226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9fdac-141c-414b-831a-dcb6f1171ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:34.065554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-acb9fdac-141c-414b-831a-dcb6f1171ee9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:34.066791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-acb9fdac-141c-414b-831a-dcb6f1171ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:34.170511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 640/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:34.208560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677596f-aa1a-401d-bc39-7e9dd3692bd4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:34.210085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8677596f-aa1a-401d-bc39-7e9dd3692bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:34.318399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677596f-aa1a-401d-bc39-7e9dd3692bd4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:34.398964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05553458-cd65-4b68-83e4-7da6473721e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:34.399981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05553458-cd65-4b68-83e4-7da6473721e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:34.400369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05553458-cd65-4b68-83e4-7da6473721e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:34.400747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05553458-cd65-4b68-83e4-7da6473721e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:34.403075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-05553458-cd65-4b68-83e4-7da6473721e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:34.525052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05553458-cd65-4b68-83e4-7da6473721e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:34.526667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05553458-cd65-4b68-83e4-7da6473721e4 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:34.547622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 674/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:21:37.472607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dd8ee-c55e-4bf1-8a5f-fe5995ceea82 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:37.473161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dd8ee-c55e-4bf1-8a5f-fe5995ceea82 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:37.473161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dd8ee-c55e-4bf1-8a5f-fe5995ceea82 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:37.474531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 641/1315] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:37.480179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d1eb-6e72-4993-b8d8-27d33441ab6b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:37.480606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d1eb-6e72-4993-b8d8-27d33441ab6b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:37.480714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d1eb-6e72-4993-b8d8-27d33441ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:37.546858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e8d9d1eb-6e72-4993-b8d8-27d33441ab6b None None] MFA Rules not processed for user `723b2f68275d429fa7e2f11e555e86b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:37.548119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e8d9d1eb-6e72-4993-b8d8-27d33441ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:37.641406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 675/1316] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:37.682367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dd8ee-c55e-4bf1-8a5f-fe5995ceea82 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:37.684648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-485dd8ee-c55e-4bf1-8a5f-fe5995ceea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:37.796008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dd8ee-c55e-4bf1-8a5f-fe5995ceea82 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:37.869697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ac9dd-6df4-4e5a-98f9-6b036f6bdc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:37.870347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ac9dd-6df4-4e5a-98f9-6b036f6bdc3c service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:37.870629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ac9dd-6df4-4e5a-98f9-6b036f6bdc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:37.871544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ac9dd-6df4-4e5a-98f9-6b036f6bdc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:37.873207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-159ac9dd-6df4-4e5a-98f9-6b036f6bdc3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:37.982338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ac9dd-6df4-4e5a-98f9-6b036f6bdc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:37.983815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ac9dd-6df4-4e5a-98f9-6b036f6bdc3c service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:38.002477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 642/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:21:41.096231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bc398-a448-49b7-829c-f213a91afc9f None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:41.096921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bc398-a448-49b7-829c-f213a91afc9f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:41.096921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bc398-a448-49b7-829c-f213a91afc9f None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:41.098158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 676/1318] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:21:41.104512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569518-b44a-46fa-8646-7e245bf931d8 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:41.104983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569518-b44a-46fa-8646-7e245bf931d8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:41.105653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569518-b44a-46fa-8646-7e245bf931d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:41.175078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6a569518-b44a-46fa-8646-7e245bf931d8 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:41.176334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6a569518-b44a-46fa-8646-7e245bf931d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:41.271288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 643/1319] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:41.309929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bc398-a448-49b7-829c-f213a91afc9f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:41.311547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a53bc398-a448-49b7-829c-f213a91afc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:41.416061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bc398-a448-49b7-829c-f213a91afc9f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:41.489762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79775d9f-1aa9-495f-89b4-d7eb101c1c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:41.490416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79775d9f-1aa9-495f-89b4-d7eb101c1c67 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:41.490700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79775d9f-1aa9-495f-89b4-d7eb101c1c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:41.490972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79775d9f-1aa9-495f-89b4-d7eb101c1c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:41.492931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79775d9f-1aa9-495f-89b4-d7eb101c1c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:41.601806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79775d9f-1aa9-495f-89b4-d7eb101c1c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:41.603307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79775d9f-1aa9-495f-89b4-d7eb101c1c67 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:41.622583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 677/1320] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:21:44.987877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c69a0-39d2-4ce7-97cd-87ff0ec9b14b None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:44.988520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c69a0-39d2-4ce7-97cd-87ff0ec9b14b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:44.988520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c69a0-39d2-4ce7-97cd-87ff0ec9b14b None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:44.989805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 644/1321] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:44.995643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe054d8-97b8-4624-92d9-d7ef2ce7f7f9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:44.996093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe054d8-97b8-4624-92d9-d7ef2ce7f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:44.996410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe054d8-97b8-4624-92d9-d7ef2ce7f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:45.063839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ffe054d8-97b8-4624-92d9-d7ef2ce7f7f9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:45.065046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ffe054d8-97b8-4624-92d9-d7ef2ce7f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:45.168912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 678/1322] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:45.212601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c69a0-39d2-4ce7-97cd-87ff0ec9b14b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:45.214195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-fb3c69a0-39d2-4ce7-97cd-87ff0ec9b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:45.325337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c69a0-39d2-4ce7-97cd-87ff0ec9b14b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:45.404336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cce44-82f9-4b4d-a865-c8b4f9d5ac71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:45.404999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cce44-82f9-4b4d-a865-c8b4f9d5ac71 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:45.405288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cce44-82f9-4b4d-a865-c8b4f9d5ac71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:45.405591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cce44-82f9-4b4d-a865-c8b4f9d5ac71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:45.407227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-226cce44-82f9-4b4d-a865-c8b4f9d5ac71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:45.522892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cce44-82f9-4b4d-a865-c8b4f9d5ac71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:45.524355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cce44-82f9-4b4d-a865-c8b4f9d5ac71 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:45.544286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 645/1323] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:21:47.901451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cb5ed-534f-430f-ad95-1c918a90f03d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:47.902060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cb5ed-534f-430f-ad95-1c918a90f03d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:47.902060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cb5ed-534f-430f-ad95-1c918a90f03d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:47.903704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 679/1324] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:47.909525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5fad-5c54-4ecd-87a8-2900c0095067 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:47.910135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5fad-5c54-4ecd-87a8-2900c0095067 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:47.910135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5fad-5c54-4ecd-87a8-2900c0095067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:47.973415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-444e5fad-5c54-4ecd-87a8-2900c0095067 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:47.974613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-444e5fad-5c54-4ecd-87a8-2900c0095067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:48.075166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 646/1325] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:48.128842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddad29d-052a-4a8b-b6f3-f4781dc64538 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:48.129166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddad29d-052a-4a8b-b6f3-f4781dc64538 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:48.129471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddad29d-052a-4a8b-b6f3-f4781dc64538 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:48.130855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 680/1326] 10.222.0.55 () {54 vars in 964 bytes} [Thu May 5 15:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:48.137247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e1ab7-df66-4648-a11c-1b225cb0a825 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:48.137536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e1ab7-df66-4648-a11c-1b225cb0a825 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:48.137814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e1ab7-df66-4648-a11c-1b225cb0a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:48.213299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-db4e1ab7-df66-4648-a11c-1b225cb0a825 None None] MFA Rules not processed for user `9c25e83af7604455bad1d7c0ee1c0122`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:48.214541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-db4e1ab7-df66-4648-a11c-1b225cb0a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:48.290238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 647/1327] 10.222.0.55 () {58 vars in 1061 bytes} [Thu May 5 15:21:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:21:48.299695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddad29d-052a-4a8b-b6f3-f4781dc64538 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:48.301249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0ddad29d-052a-4a8b-b6f3-f4781dc64538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:48.405810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddad29d-052a-4a8b-b6f3-f4781dc64538 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:48.478210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea9ff-7f5a-4522-877d-c2a4dbca281d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:48.478858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea9ff-7f5a-4522-877d-c2a4dbca281d service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:48.479137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea9ff-7f5a-4522-877d-c2a4dbca281d service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:48.479408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea9ff-7f5a-4522-877d-c2a4dbca281d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:48.481071 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bf2ea9ff-7f5a-4522-877d-c2a4dbca281d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:48.589105 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea9ff-7f5a-4522-877d-c2a4dbca281d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:48.590557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea9ff-7f5a-4522-877d-c2a4dbca281d service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:48.608778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 681/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:21:51.175881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045dafb-2967-4051-9b42-a83b823689d9 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:51.176459 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045dafb-2967-4051-9b42-a83b823689d9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:51.176459 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045dafb-2967-4051-9b42-a83b823689d9 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:51.177865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 648/1329] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:51.183837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f823-a67c-4560-b893-7c565642166e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:51.184383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f823-a67c-4560-b893-7c565642166e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:51.184383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f823-a67c-4560-b893-7c565642166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:51.255686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b7a6f823-a67c-4560-b893-7c565642166e None None] MFA Rules not processed for user `723b2f68275d429fa7e2f11e555e86b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:51.256907 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b7a6f823-a67c-4560-b893-7c565642166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:51.361635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 682/1330] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:51.400436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045dafb-2967-4051-9b42-a83b823689d9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:51.402098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9045dafb-2967-4051-9b42-a83b823689d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:51.504242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045dafb-2967-4051-9b42-a83b823689d9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:51.579925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23e239-f43e-4750-b899-206dc1635c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:51.580572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e239-f43e-4750-b899-206dc1635c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:51.580857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e239-f43e-4750-b899-206dc1635c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:51.581134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e239-f43e-4750-b899-206dc1635c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:51.582757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1b23e239-f43e-4750-b899-206dc1635c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:51.688404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23e239-f43e-4750-b899-206dc1635c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:51.689845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23e239-f43e-4750-b899-206dc1635c39 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:51.708914 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 649/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:21:54.436168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d28244-f518-4dc6-b2ce-f21d161cfcd1 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:54.436699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d28244-f518-4dc6-b2ce-f21d161cfcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:54.436699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d28244-f518-4dc6-b2ce-f21d161cfcd1 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:54.438108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 683/1332] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:54.443924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98748-65df-4cd4-add7-a2a318bbc1dc None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:54.443924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98748-65df-4cd4-add7-a2a318bbc1dc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:54.444501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98748-65df-4cd4-add7-a2a318bbc1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:54.521502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-17e98748-65df-4cd4-add7-a2a318bbc1dc None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:54.522742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-17e98748-65df-4cd4-add7-a2a318bbc1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:54.635296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 650/1333] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:54.672335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d28244-f518-4dc6-b2ce-f21d161cfcd1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:54.673932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-93d28244-f518-4dc6-b2ce-f21d161cfcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:54.792763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d28244-f518-4dc6-b2ce-f21d161cfcd1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:54.875592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0522-559b-441e-ada4-3a0d5c3b356d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:54.876260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0522-559b-441e-ada4-3a0d5c3b356d service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:54.876550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0522-559b-441e-ada4-3a0d5c3b356d service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:54.876877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0522-559b-441e-ada4-3a0d5c3b356d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:54.878618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5b1a0522-559b-441e-ada4-3a0d5c3b356d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:55.016989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a0522-559b-441e-ada4-3a0d5c3b356d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:55.019799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a0522-559b-441e-ada4-3a0d5c3b356d service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:55.046973 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 684/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:21:57.377725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634aebc-4031-4d32-9715-e7e3391b219e None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:57.378293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634aebc-4031-4d32-9715-e7e3391b219e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:57.378293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634aebc-4031-4d32-9715-e7e3391b219e None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:57.379675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 651/1335] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:21:57.385216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13996-637e-4cc2-9ba1-8809f5b307d6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:57.385731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13996-637e-4cc2-9ba1-8809f5b307d6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:57.385836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13996-637e-4cc2-9ba1-8809f5b307d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:57.451256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4db13996-637e-4cc2-9ba1-8809f5b307d6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:21:57.452488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4db13996-637e-4cc2-9ba1-8809f5b307d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:57.546638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 685/1336] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:21:57.585540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634aebc-4031-4d32-9715-e7e3391b219e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:21:57.587061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1634aebc-4031-4d32-9715-e7e3391b219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:57.689700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634aebc-4031-4d32-9715-e7e3391b219e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:21:57.762498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439b977-48a9-4940-877d-08e350f8b1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:21:57.763148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b977-48a9-4940-877d-08e350f8b1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:21:57.763431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b977-48a9-4940-877d-08e350f8b1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:21:57.763730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b977-48a9-4940-877d-08e350f8b1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:21:57.765346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7439b977-48a9-4940-877d-08e350f8b1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:21:57.873580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439b977-48a9-4940-877d-08e350f8b1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:21:57.874924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439b977-48a9-4940-877d-08e350f8b1f6 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:21:57.893081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 652/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:01.008063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246098-0c91-428f-a0b1-59492725c74b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:01.008589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246098-0c91-428f-a0b1-59492725c74b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:01.008589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246098-0c91-428f-a0b1-59492725c74b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:01.009912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 686/1338] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:01.015570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1474c-e432-49c9-9596-b942bc90824e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:01.016063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1474c-e432-49c9-9596-b942bc90824e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:01.016155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1474c-e432-49c9-9596-b942bc90824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:01.086062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-75a1474c-e432-49c9-9596-b942bc90824e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:01.087306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-75a1474c-e432-49c9-9596-b942bc90824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:01.192418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 653/1339] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:01.228180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246098-0c91-428f-a0b1-59492725c74b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:01.230998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52246098-0c91-428f-a0b1-59492725c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:01.332939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246098-0c91-428f-a0b1-59492725c74b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:01.337910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e06f89-086e-45d1-9d83-d35f7e385374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:01.337910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06f89-086e-45d1-9d83-d35f7e385374 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:01.337910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06f89-086e-45d1-9d83-d35f7e385374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:01.337910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06f89-086e-45d1-9d83-d35f7e385374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:01.348213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e06f89-086e-45d1-9d83-d35f7e385374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:01.350081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e06f89-086e-45d1-9d83-d35f7e385374 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:01.361610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 687/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:05.936480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca14e3-9a1b-4162-b3ce-7341446c4d2c None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:05.937043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca14e3-9a1b-4162-b3ce-7341446c4d2c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:05.937043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca14e3-9a1b-4162-b3ce-7341446c4d2c None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:05.938305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 654/1341] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:22:05.943724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccc80-4bc2-4294-981d-414e9329eeea None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:05.944198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccc80-4bc2-4294-981d-414e9329eeea None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:05.944300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccc80-4bc2-4294-981d-414e9329eeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:05.974464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9e1ccc80-4bc2-4294-981d-414e9329eeea None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:05.975611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9e1ccc80-4bc2-4294-981d-414e9329eeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:06.055277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 688/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:06.093680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca14e3-9a1b-4162-b3ce-7341446c4d2c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:06.095504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bbca14e3-9a1b-4162-b3ce-7341446c4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:06.108347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca14e3-9a1b-4162-b3ce-7341446c4d2c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:06.111804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51707f0e-36a2-4fe9-a533-209efc02a634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:06.112463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707f0e-36a2-4fe9-a533-209efc02a634 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:06.112743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707f0e-36a2-4fe9-a533-209efc02a634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:06.113016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707f0e-36a2-4fe9-a533-209efc02a634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:06.122288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51707f0e-36a2-4fe9-a533-209efc02a634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:06.123738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51707f0e-36a2-4fe9-a533-209efc02a634 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:06.133077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 655/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:09.877708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bd65c-ee83-4065-a487-dd887335cde3 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:09.878261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bd65c-ee83-4065-a487-dd887335cde3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:09.878261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bd65c-ee83-4065-a487-dd887335cde3 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:09.879717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 689/1344] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:09.885377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885e72-28d4-4c35-9dfd-1d094f536aa5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:09.885835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885e72-28d4-4c35-9dfd-1d094f536aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:09.885944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885e72-28d4-4c35-9dfd-1d094f536aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:09.903154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1f885e72-28d4-4c35-9dfd-1d094f536aa5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:09.904372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1f885e72-28d4-4c35-9dfd-1d094f536aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:09.912194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 656/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:09.962286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bd65c-ee83-4065-a487-dd887335cde3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:09.970711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bd65c-ee83-4065-a487-dd887335cde3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:09.974204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fe308-fda9-462f-b630-7eb0736cfcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:09.974837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fe308-fda9-462f-b630-7eb0736cfcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:09.975113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fe308-fda9-462f-b630-7eb0736cfcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:09.975385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fe308-fda9-462f-b630-7eb0736cfcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:09.989691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fe308-fda9-462f-b630-7eb0736cfcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:09.991121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fe308-fda9-462f-b630-7eb0736cfcc0 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:10.001686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 690/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:14.656753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11604587-430d-47fe-8820-71f91b2d4fd3 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:14.657430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11604587-430d-47fe-8820-71f91b2d4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:14.657711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11604587-430d-47fe-8820-71f91b2d4fd3 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:14.659174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 657/1347] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:14.664560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535f79-1571-4f88-a721-670aeb100e56 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:14.664996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535f79-1571-4f88-a721-670aeb100e56 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:14.665090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535f79-1571-4f88-a721-670aeb100e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:14.682983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a1535f79-1571-4f88-a721-670aeb100e56 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:14.684203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a1535f79-1571-4f88-a721-670aeb100e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:14.692127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 691/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:14.729957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11604587-430d-47fe-8820-71f91b2d4fd3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:14.740643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11604587-430d-47fe-8820-71f91b2d4fd3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:14.744574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d2ff3-c433-4e58-906a-a59a2b123b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:14.745242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d2ff3-c433-4e58-906a-a59a2b123b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:14.745526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d2ff3-c433-4e58-906a-a59a2b123b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:14.745802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d2ff3-c433-4e58-906a-a59a2b123b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:14.755545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d2ff3-c433-4e58-906a-a59a2b123b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:14.757057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d2ff3-c433-4e58-906a-a59a2b123b0f service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:14.766772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 658/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:20.115158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42111-a444-4b0c-8435-32232b32b04f None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:20.115709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42111-a444-4b0c-8435-32232b32b04f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:20.116222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42111-a444-4b0c-8435-32232b32b04f None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:20.117668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 692/1350] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:22:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:20.122913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6584c9-d248-4f2b-9d7f-bbfa027ad96e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:20.123369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6584c9-d248-4f2b-9d7f-bbfa027ad96e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:20.123501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6584c9-d248-4f2b-9d7f-bbfa027ad96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:20.212979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-2b6584c9-d248-4f2b-9d7f-bbfa027ad96e None None] MFA Rules not processed for user `4b8520e6db2346c59a1230380c515703`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:20.214448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2b6584c9-d248-4f2b-9d7f-bbfa027ad96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:20.295821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 659/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:22:24.740596 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8a83-777c-464d-8df9-04ab1d81a283 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:24.741733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8a83-777c-464d-8df9-04ab1d81a283 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:24.742005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8a83-777c-464d-8df9-04ab1d81a283 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:24.743382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 693/1352] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:24.749553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f35bd-7661-4514-8c71-60b3ae165469 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:24.750103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f35bd-7661-4514-8c71-60b3ae165469 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:24.750354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f35bd-7661-4514-8c71-60b3ae165469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:24.770075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e58f35bd-7661-4514-8c71-60b3ae165469 None None] MFA Rules not processed for user `4b8520e6db2346c59a1230380c515703`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:24.771368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e58f35bd-7661-4514-8c71-60b3ae165469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:24.780891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 660/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:26.398988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd242-a38d-4019-bdb3-c278ee7219dc None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:26.399448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd242-a38d-4019-bdb3-c278ee7219dc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:26.399577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd242-a38d-4019-bdb3-c278ee7219dc None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:26.401505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 694/1354] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:26.406471 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1802-36ec-455b-b073-a8a397cbc23b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:26.406940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1802-36ec-455b-b073-a8a397cbc23b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:26.407125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1802-36ec-455b-b073-a8a397cbc23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:26.425148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c26b1802-36ec-455b-b073-a8a397cbc23b None None] MFA Rules not processed for user `4b8520e6db2346c59a1230380c515703`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:26.426465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c26b1802-36ec-455b-b073-a8a397cbc23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:26.435670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 661/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:22:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:30.229502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db065-44a8-4af2-a0e3-1dc978bcc036 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:30.230022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db065-44a8-4af2-a0e3-1dc978bcc036 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:30.230022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db065-44a8-4af2-a0e3-1dc978bcc036 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:30.231334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 695/1356] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:22:30.237061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32ebdc-3550-48a5-a397-64ac188fc575 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:30.237517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32ebdc-3550-48a5-a397-64ac188fc575 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:30.237678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32ebdc-3550-48a5-a397-64ac188fc575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:30.256806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ad32ebdc-3550-48a5-a397-64ac188fc575 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:30.257966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ad32ebdc-3550-48a5-a397-64ac188fc575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:30.266373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 662/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:22:30.315396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc291320-aae8-4550-a341-116c7f326675 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:30.315738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc291320-aae8-4550-a341-116c7f326675 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:30.316011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc291320-aae8-4550-a341-116c7f326675 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:30.317500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 696/1358] 10.222.0.55 () {54 vars in 960 bytes} [Thu May 5 15:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:30.323670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cfa29-1de7-4eb4-a75f-9abe5dfb1846 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:30.324070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cfa29-1de7-4eb4-a75f-9abe5dfb1846 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:30.324829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cfa29-1de7-4eb4-a75f-9abe5dfb1846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:30.373420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-039cfa29-1de7-4eb4-a75f-9abe5dfb1846 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:30.374733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-039cfa29-1de7-4eb4-a75f-9abe5dfb1846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:30.458542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 663/1359] 10.222.0.55 () {58 vars in 1057 bytes} [Thu May 5 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:30.467837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc291320-aae8-4550-a341-116c7f326675 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:30.483199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc291320-aae8-4550-a341-116c7f326675 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:30.489666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aa7e5-3929-495d-942d-3a929feb929b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:30.490507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa7e5-3929-495d-942d-3a929feb929b service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:30.491236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa7e5-3929-495d-942d-3a929feb929b service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:30.491727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa7e5-3929-495d-942d-3a929feb929b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:30.502650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aa7e5-3929-495d-942d-3a929feb929b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:30.504615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aa7e5-3929-495d-942d-3a929feb929b service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:30.515913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 697/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:22:33.046457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e7b50-825c-47e0-a802-a8e71670852a None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:33.047006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e7b50-825c-47e0-a802-a8e71670852a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:33.047006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e7b50-825c-47e0-a802-a8e71670852a None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:33.048337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 664/1361] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:33.053474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaa30e-8e9b-4e44-8630-87abbe074c51 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:33.053904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaa30e-8e9b-4e44-8630-87abbe074c51 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:33.054032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaa30e-8e9b-4e44-8630-87abbe074c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:33.071983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-08aaa30e-8e9b-4e44-8630-87abbe074c51 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:33.073158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-08aaa30e-8e9b-4e44-8630-87abbe074c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:33.080939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 698/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:33.126251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e7b50-825c-47e0-a802-a8e71670852a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:33.141660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e7b50-825c-47e0-a802-a8e71670852a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:33.147425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034305a2-b052-43b0-ae69-f3059a9dabcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:33.148080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034305a2-b052-43b0-ae69-f3059a9dabcf service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:33.149004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034305a2-b052-43b0-ae69-f3059a9dabcf service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:33.149289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034305a2-b052-43b0-ae69-f3059a9dabcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:33.158680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034305a2-b052-43b0-ae69-f3059a9dabcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:33.160334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034305a2-b052-43b0-ae69-f3059a9dabcf service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:33.170109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 665/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:35.928713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8f22-d231-4517-ae91-c33e628c1d1d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:35.929318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8f22-d231-4517-ae91-c33e628c1d1d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:35.929318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8f22-d231-4517-ae91-c33e628c1d1d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:35.930944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 699/1364] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:35.936476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d337f-e909-4725-82ab-6c1c59d64985 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:35.936955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d337f-e909-4725-82ab-6c1c59d64985 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:35.937126 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d337f-e909-4725-82ab-6c1c59d64985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:35.965979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f35d337f-e909-4725-82ab-6c1c59d64985 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:35.967353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f35d337f-e909-4725-82ab-6c1c59d64985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:35.976390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 666/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:22:36.024834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9f02-be30-453e-beea-bcf1a051c1e5 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:36.025172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9f02-be30-453e-beea-bcf1a051c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:36.025384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9f02-be30-453e-beea-bcf1a051c1e5 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:36.026762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 700/1366] 10.222.0.55 () {54 vars in 960 bytes} [Thu May 5 15:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:36.032232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5b27-556a-487a-afca-735f357cb819 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:36.032637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5b27-556a-487a-afca-735f357cb819 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:36.033024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5b27-556a-487a-afca-735f357cb819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:36.050673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-2cfa5b27-556a-487a-afca-735f357cb819 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:36.051924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2cfa5b27-556a-487a-afca-735f357cb819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:36.062333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 667/1367] 10.222.0.55 () {58 vars in 1057 bytes} [Thu May 5 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:36.070289 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a9f02-be30-453e-beea-bcf1a051c1e5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:36.085429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a9f02-be30-453e-beea-bcf1a051c1e5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:36.090661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c9de9-0913-4727-8598-6734d6a6e71f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:36.091405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c9de9-0913-4727-8598-6734d6a6e71f service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:36.091631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c9de9-0913-4727-8598-6734d6a6e71f service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:36.091917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c9de9-0913-4727-8598-6734d6a6e71f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:36.099858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c9de9-0913-4727-8598-6734d6a6e71f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:36.101468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c9de9-0913-4727-8598-6734d6a6e71f service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:36.110685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 701/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:38.595182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a603b-359f-4989-95a2-ee613402f8b6 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:38.595772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a603b-359f-4989-95a2-ee613402f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:38.595772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a603b-359f-4989-95a2-ee613402f8b6 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:38.597135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 668/1369] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:38.603185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d16e-b920-400f-a3b8-71b9391ef68f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:38.604024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d16e-b920-400f-a3b8-71b9391ef68f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:38.604312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d16e-b920-400f-a3b8-71b9391ef68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:38.622224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-87c4d16e-b920-400f-a3b8-71b9391ef68f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:38.623443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-87c4d16e-b920-400f-a3b8-71b9391ef68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:38.633010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 702/1370] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:38.677440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a603b-359f-4989-95a2-ee613402f8b6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:38.692091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a603b-359f-4989-95a2-ee613402f8b6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:38.698649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d17ac5-4539-4120-8779-a2a5c6fd5042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:38.699311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d17ac5-4539-4120-8779-a2a5c6fd5042 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:38.699634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d17ac5-4539-4120-8779-a2a5c6fd5042 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:38.699916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d17ac5-4539-4120-8779-a2a5c6fd5042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:38.709204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d17ac5-4539-4120-8779-a2a5c6fd5042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:38.710814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d17ac5-4539-4120-8779-a2a5c6fd5042 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:38.726641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 669/1371] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:38.768000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a404-4b91-4ac0-b9f7-f311e19c1470 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:38.768000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a404-4b91-4ac0-b9f7-f311e19c1470 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:38.768000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a404-4b91-4ac0-b9f7-f311e19c1470 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:38.768000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 703/1372] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:38.768441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6df47-1b51-4aa9-bce6-04a7a294e8a9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:38.768441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6df47-1b51-4aa9-bce6-04a7a294e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:38.768441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6df47-1b51-4aa9-bce6-04a7a294e8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:38.783176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-32e6df47-1b51-4aa9-bce6-04a7a294e8a9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:38.784413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-32e6df47-1b51-4aa9-bce6-04a7a294e8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:38.792638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 670/1373] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:39.124359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43653-ef09-4cad-a06b-e06dfd7cbe85 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:39.124602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43653-ef09-4cad-a06b-e06dfd7cbe85 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:39.125137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43653-ef09-4cad-a06b-e06dfd7cbe85 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:39.126573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 704/1374] 10.222.0.55 () {54 vars in 963 bytes} [Thu May 5 15:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:39.132085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7875e95-cabc-448c-a0fc-aaf058b34055 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:39.132378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7875e95-cabc-448c-a0fc-aaf058b34055 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:39.132659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7875e95-cabc-448c-a0fc-aaf058b34055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:39.182335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a7875e95-cabc-448c-a0fc-aaf058b34055 None None] MFA Rules not processed for user `fd89045deca342e5a4a6fa39c5bde4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:39.183448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a7875e95-cabc-448c-a0fc-aaf058b34055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:39.244797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 671/1375] 10.222.0.55 () {58 vars in 1060 bytes} [Thu May 5 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:39.252861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e43653-ef09-4cad-a06b-e06dfd7cbe85 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:39.264132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e43653-ef09-4cad-a06b-e06dfd7cbe85 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:39.267793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8530f2-9464-4693-9d77-7ee6063ce04c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:39.268501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8530f2-9464-4693-9d77-7ee6063ce04c service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:39.268962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8530f2-9464-4693-9d77-7ee6063ce04c service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:39.269326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8530f2-9464-4693-9d77-7ee6063ce04c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:39.279313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8530f2-9464-4693-9d77-7ee6063ce04c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:39.280887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8530f2-9464-4693-9d77-7ee6063ce04c service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:39.292403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 705/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:41.177312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6e34-0d04-4ca0-8b8d-b42209395c10 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:41.177858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6e34-0d04-4ca0-8b8d-b42209395c10 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:41.177858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6e34-0d04-4ca0-8b8d-b42209395c10 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:41.179255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 672/1377] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:41.184927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9740f-8259-4c23-9f48-1b221f6b2d3a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:41.185456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9740f-8259-4c23-9f48-1b221f6b2d3a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:41.185651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9740f-8259-4c23-9f48-1b221f6b2d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:41.205161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-38b9740f-8259-4c23-9f48-1b221f6b2d3a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:41.206404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-38b9740f-8259-4c23-9f48-1b221f6b2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:41.215552 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 706/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:41.262647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e6e34-0d04-4ca0-8b8d-b42209395c10 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:41.278158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e6e34-0d04-4ca0-8b8d-b42209395c10 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:41.284076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033eab7-df25-4919-a3c0-51029c9c78b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:41.284774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033eab7-df25-4919-a3c0-51029c9c78b4 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:41.285056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033eab7-df25-4919-a3c0-51029c9c78b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:41.285333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033eab7-df25-4919-a3c0-51029c9c78b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:41.294395 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033eab7-df25-4919-a3c0-51029c9c78b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:41.296033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033eab7-df25-4919-a3c0-51029c9c78b4 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:41.306642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 673/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:43.760177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542347a-262e-485a-bd6d-5e27ea952447 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:43.760658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542347a-262e-485a-bd6d-5e27ea952447 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:43.760808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542347a-262e-485a-bd6d-5e27ea952447 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:43.762084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 707/1380] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:43.767399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16b318-8a7c-42b5-987b-596173292b11 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:43.767883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16b318-8a7c-42b5-987b-596173292b11 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:43.768060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16b318-8a7c-42b5-987b-596173292b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:43.785976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7e16b318-8a7c-42b5-987b-596173292b11 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:43.787267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7e16b318-8a7c-42b5-987b-596173292b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:43.795575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 674/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:43.842163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542347a-262e-485a-bd6d-5e27ea952447 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:43.859058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542347a-262e-485a-bd6d-5e27ea952447 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:43.864657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e52d-3716-4fdf-b6b9-e76ce798f30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:43.865551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e52d-3716-4fdf-b6b9-e76ce798f30c service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:43.865831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e52d-3716-4fdf-b6b9-e76ce798f30c service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:43.866104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e52d-3716-4fdf-b6b9-e76ce798f30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:43.874469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e52d-3716-4fdf-b6b9-e76ce798f30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:43.876127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e52d-3716-4fdf-b6b9-e76ce798f30c service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:43.885773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 708/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:46.426911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292459-e130-49c1-9e62-107e0ceea6c6 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:46.427548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292459-e130-49c1-9e62-107e0ceea6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:46.427548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292459-e130-49c1-9e62-107e0ceea6c6 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:46.429212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 675/1383] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:46.437189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7cfc4-8dd4-4d15-ad0e-c1e2ead2bbf2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:46.437638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7cfc4-8dd4-4d15-ad0e-c1e2ead2bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:46.438017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7cfc4-8dd4-4d15-ad0e-c1e2ead2bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:46.457012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-65c7cfc4-8dd4-4d15-ad0e-c1e2ead2bbf2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:46.458196 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-65c7cfc4-8dd4-4d15-ad0e-c1e2ead2bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:46.466782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 709/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:46.508331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a292459-e130-49c1-9e62-107e0ceea6c6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:46.523681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a292459-e130-49c1-9e62-107e0ceea6c6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:46.529683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6b1ef-7fb0-4ff6-8d30-db538d73e732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:46.530621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b1ef-7fb0-4ff6-8d30-db538d73e732 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:46.530999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b1ef-7fb0-4ff6-8d30-db538d73e732 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:46.531373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b1ef-7fb0-4ff6-8d30-db538d73e732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:46.540924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6b1ef-7fb0-4ff6-8d30-db538d73e732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:46.542811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6b1ef-7fb0-4ff6-8d30-db538d73e732 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:46.553206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 676/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:49.407001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed495ebe-caeb-467a-b570-a4ce8f0d47e2 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:49.407812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed495ebe-caeb-467a-b570-a4ce8f0d47e2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:49.407812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed495ebe-caeb-467a-b570-a4ce8f0d47e2 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:49.409197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 710/1386] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:49.414647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f8ed-3453-46cd-a92c-74fbba0a46d7 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:49.415318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f8ed-3453-46cd-a92c-74fbba0a46d7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:49.415318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f8ed-3453-46cd-a92c-74fbba0a46d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:49.433084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c5a4f8ed-3453-46cd-a92c-74fbba0a46d7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:49.434288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c5a4f8ed-3453-46cd-a92c-74fbba0a46d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:49.442400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 677/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:49.488241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed495ebe-caeb-467a-b570-a4ce8f0d47e2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:49.509677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed495ebe-caeb-467a-b570-a4ce8f0d47e2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:49.516326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93a10-ba6b-4438-bb66-cbb7aacfa68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:49.516988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93a10-ba6b-4438-bb66-cbb7aacfa68f service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:49.517319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93a10-ba6b-4438-bb66-cbb7aacfa68f service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:49.517571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93a10-ba6b-4438-bb66-cbb7aacfa68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:49.530385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93a10-ba6b-4438-bb66-cbb7aacfa68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:49.532050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93a10-ba6b-4438-bb66-cbb7aacfa68f service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:49.542334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 711/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:52.102766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847e733-3ab1-4dcc-802f-b187af8d739f None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:52.103588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847e733-3ab1-4dcc-802f-b187af8d739f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:52.103588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847e733-3ab1-4dcc-802f-b187af8d739f None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:52.104710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 678/1389] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:52.110867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde19f5-421a-4b52-893b-4c8f427a0466 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:52.111364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde19f5-421a-4b52-893b-4c8f427a0466 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:52.111791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde19f5-421a-4b52-893b-4c8f427a0466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:52.136841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bcde19f5-421a-4b52-893b-4c8f427a0466 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:52.138698 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bcde19f5-421a-4b52-893b-4c8f427a0466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:52.150580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 712/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:52.215666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847e733-3ab1-4dcc-802f-b187af8d739f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:52.230028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847e733-3ab1-4dcc-802f-b187af8d739f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:52.235637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bda1f4-82ed-4f46-8ade-67f222c798d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:52.236274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda1f4-82ed-4f46-8ade-67f222c798d0 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:52.236561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda1f4-82ed-4f46-8ade-67f222c798d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:52.236838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda1f4-82ed-4f46-8ade-67f222c798d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:52.246011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bda1f4-82ed-4f46-8ade-67f222c798d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:52.247863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bda1f4-82ed-4f46-8ade-67f222c798d0 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:52.259121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 679/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:54.772550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9612b-52a1-4491-a950-4a837e43f592 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:54.773135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9612b-52a1-4491-a950-4a837e43f592 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:54.773135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9612b-52a1-4491-a950-4a837e43f592 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:54.775171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 713/1392] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:54.780272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9fac-20f8-4f69-8e44-f2bfc160ff15 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:54.780736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9fac-20f8-4f69-8e44-f2bfc160ff15 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:54.780829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9fac-20f8-4f69-8e44-f2bfc160ff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:54.798218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6b4a9fac-20f8-4f69-8e44-f2bfc160ff15 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:54.799414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6b4a9fac-20f8-4f69-8e44-f2bfc160ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:54.807934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 680/1393] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:54.851517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9612b-52a1-4491-a950-4a837e43f592 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:54.866525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9612b-52a1-4491-a950-4a837e43f592 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:54.872775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e940f-7c46-412e-a889-d0de157e1b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:54.875644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e940f-7c46-412e-a889-d0de157e1b29 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:54.875644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e940f-7c46-412e-a889-d0de157e1b29 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:54.875644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e940f-7c46-412e-a889-d0de157e1b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:54.883557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e940f-7c46-412e-a889-d0de157e1b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:54.885268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e940f-7c46-412e-a889-d0de157e1b29 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:54.894828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 714/1394] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:55.547000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950726-e0de-4640-8c9b-b922ac391b46 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:55.547292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950726-e0de-4640-8c9b-b922ac391b46 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:55.547674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950726-e0de-4640-8c9b-b922ac391b46 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:55.549073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 681/1395] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:55.554512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d303e-bb1a-4d9a-9ec8-dc15e7f5642c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:55.555389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d303e-bb1a-4d9a-9ec8-dc15e7f5642c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:55.555775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d303e-bb1a-4d9a-9ec8-dc15e7f5642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:55.582697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a06d303e-bb1a-4d9a-9ec8-dc15e7f5642c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:55.583927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a06d303e-bb1a-4d9a-9ec8-dc15e7f5642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:55.592410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 715/1396] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:55.648713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c3cb-01b8-4f61-a282-58c93404b811 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:55.649209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c3cb-01b8-4f61-a282-58c93404b811 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:55.649489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c3cb-01b8-4f61-a282-58c93404b811 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:55.650834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 682/1397] 10.222.0.55 () {54 vars in 962 bytes} [Thu May 5 15:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:55.656104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1fd2-25ca-4a3d-8671-141244f8831a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:55.656395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1fd2-25ca-4a3d-8671-141244f8831a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:55.656674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1fd2-25ca-4a3d-8671-141244f8831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:55.703515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f81a1fd2-25ca-4a3d-8671-141244f8831a None None] MFA Rules not processed for user `fc69b41ea4d6456f9532cee386265e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:55.704722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f81a1fd2-25ca-4a3d-8671-141244f8831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:55.765408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 716/1398] 10.222.0.55 () {58 vars in 1059 bytes} [Thu May 5 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:55.774362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c3cb-01b8-4f61-a282-58c93404b811 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:55.784800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c3cb-01b8-4f61-a282-58c93404b811 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:55.788427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394fd3-9ddc-4ab1-a2f7-e36c5b70129c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc69b41ea4d6456f9532cee386265e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:55.789639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394fd3-9ddc-4ab1-a2f7-e36c5b70129c service glance] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:55.789925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394fd3-9ddc-4ab1-a2f7-e36c5b70129c service glance] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:55.790207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394fd3-9ddc-4ab1-a2f7-e36c5b70129c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:55.799278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394fd3-9ddc-4ab1-a2f7-e36c5b70129c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:55.800698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394fd3-9ddc-4ab1-a2f7-e36c5b70129c service glance] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:55.810335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 683/1399] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:22:56.391965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1adaec-d4ce-4ba5-b498-71add254b5ca None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:56.392451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1adaec-d4ce-4ba5-b498-71add254b5ca None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:56.392653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1adaec-d4ce-4ba5-b498-71add254b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:56.441194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ea1adaec-d4ce-4ba5-b498-71add254b5ca None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:56.442380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ea1adaec-d4ce-4ba5-b498-71add254b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:56.503795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 717/1400] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:56.545816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685d26-2f09-4fc9-b120-4b02ae959fe1 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:56.546182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685d26-2f09-4fc9-b120-4b02ae959fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:56.546607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685d26-2f09-4fc9-b120-4b02ae959fe1 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:56.548115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 684/1401] 10.222.0.55 () {54 vars in 942 bytes} [Thu May 5 15:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:56.555433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eccde-8b8d-4b56-ad6a-53a6566c4c0f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:56.555755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eccde-8b8d-4b56-ad6a-53a6566c4c0f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:56.556038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eccde-8b8d-4b56-ad6a-53a6566c4c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:56.603865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d74eccde-8b8d-4b56-ad6a-53a6566c4c0f None None] MFA Rules not processed for user `21b75b16948240e0b3539152a63429d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:56.605129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d74eccde-8b8d-4b56-ad6a-53a6566c4c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:56.675992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 718/1402] 10.222.0.55 () {58 vars in 1039 bytes} [Thu May 5 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:56.686091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685d26-2f09-4fc9-b120-4b02ae959fe1 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:56.699677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685d26-2f09-4fc9-b120-4b02ae959fe1 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:56.704580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b577c8-a0a1-486d-abd5-32d6607113ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:56.705228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b577c8-a0a1-486d-abd5-32d6607113ae service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:56.705514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b577c8-a0a1-486d-abd5-32d6607113ae service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:56.705790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b577c8-a0a1-486d-abd5-32d6607113ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:56.714504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b577c8-a0a1-486d-abd5-32d6607113ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:56.716193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b577c8-a0a1-486d-abd5-32d6607113ae service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:56.724756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 685/1403] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:22:57.321040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca579-12b0-4c3f-aa19-26bebf6d9ba3 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:57.321040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca579-12b0-4c3f-aa19-26bebf6d9ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:57.321929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca579-12b0-4c3f-aa19-26bebf6d9ba3 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:57.323713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 719/1404] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:22:57.336366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fae8-8ccf-4f2f-b690-195ac77a67e9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:57.336965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fae8-8ccf-4f2f-b690-195ac77a67e9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:57.336965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fae8-8ccf-4f2f-b690-195ac77a67e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:57.356717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0b46fae8-8ccf-4f2f-b690-195ac77a67e9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:22:57.358061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0b46fae8-8ccf-4f2f-b690-195ac77a67e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:22:57.366548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 686/1405] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:22:57.411764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ca579-12b0-4c3f-aa19-26bebf6d9ba3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:22:57.427288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ca579-12b0-4c3f-aa19-26bebf6d9ba3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:22:57.433412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc7ce0-ae26-4c5a-8e37-a8ab60471f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:22:57.434188 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc7ce0-ae26-4c5a-8e37-a8ab60471f47 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:22:57.434576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc7ce0-ae26-4c5a-8e37-a8ab60471f47 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:22:57.434960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc7ce0-ae26-4c5a-8e37-a8ab60471f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:22:57.443490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc7ce0-ae26-4c5a-8e37-a8ab60471f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:22:57.445970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc7ce0-ae26-4c5a-8e37-a8ab60471f47 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:22:57.458494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 720/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:23:00.014687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8061f-d708-4494-931a-4af708618f3d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:00.015215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8061f-d708-4494-931a-4af708618f3d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:00.015346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8061f-d708-4494-931a-4af708618f3d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:00.016933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 687/1407] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:00.021927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb78f8-fc1f-4ed2-856a-025ec600938b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:00.022394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb78f8-fc1f-4ed2-856a-025ec600938b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:00.022488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb78f8-fc1f-4ed2-856a-025ec600938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:00.040992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-86bb78f8-fc1f-4ed2-856a-025ec600938b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:00.042211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-86bb78f8-fc1f-4ed2-856a-025ec600938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:00.050346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 721/1408] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:00.098042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8061f-d708-4494-931a-4af708618f3d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:00.113855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8061f-d708-4494-931a-4af708618f3d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:00.119888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d1134-20b8-4a94-8fa1-5c55a393a260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:00.120667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d1134-20b8-4a94-8fa1-5c55a393a260 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:00.121013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d1134-20b8-4a94-8fa1-5c55a393a260 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:00.121358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d1134-20b8-4a94-8fa1-5c55a393a260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:00.129712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d1134-20b8-4a94-8fa1-5c55a393a260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:00.131401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d1134-20b8-4a94-8fa1-5c55a393a260 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:00.142191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 688/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:21.861985 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c01f-d096-43ac-9dae-501e2af4dd75 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:21.862633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c01f-d096-43ac-9dae-501e2af4dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:21.862633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c01f-d096-43ac-9dae-501e2af4dd75 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:21.864235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 722/1410] 10.222.0.55 () {54 vars in 918 bytes} [Thu May 5 15:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:21.870135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beca73-90cb-45a6-90d9-26356762445f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:21.870659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beca73-90cb-45a6-90d9-26356762445f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:21.870768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beca73-90cb-45a6-90d9-26356762445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:21.889036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b8beca73-90cb-45a6-90d9-26356762445f None None] MFA Rules not processed for user `4b8520e6db2346c59a1230380c515703`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:21.890220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b8beca73-90cb-45a6-90d9-26356762445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:21.898910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 689/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Thu May 5 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:21.915054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a0f9-982e-4aac-aff7-dbd6ad4efd2d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:21.915054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a0f9-982e-4aac-aff7-dbd6ad4efd2d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:21.915054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a0f9-982e-4aac-aff7-dbd6ad4efd2d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:21.915817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 723/1412] 10.222.0.55 () {54 vars in 918 bytes} [Thu May 5 15:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:21.920683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c26e2-8c68-4cc0-ac31-7d8ae84229c5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:21.921026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c26e2-8c68-4cc0-ac31-7d8ae84229c5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:21.921341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c26e2-8c68-4cc0-ac31-7d8ae84229c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:21.940297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-031c26e2-8c68-4cc0-ac31-7d8ae84229c5 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:21.945890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-031c26e2-8c68-4cc0-ac31-7d8ae84229c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:21.951236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 690/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Thu May 5 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:23:24.653578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0dc3f-72bd-4144-adf8-ce8b25c95a9a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:24.654135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0dc3f-72bd-4144-adf8-ce8b25c95a9a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:24.654135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0dc3f-72bd-4144-adf8-ce8b25c95a9a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:24.655494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 724/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:24.660807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671859-4414-4c82-9825-c281772b8ebe None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:24.661268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671859-4414-4c82-9825-c281772b8ebe None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:24.661378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671859-4414-4c82-9825-c281772b8ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:24.678850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0b671859-4414-4c82-9825-c281772b8ebe None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:24.679996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0b671859-4414-4c82-9825-c281772b8ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:24.687974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 691/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:24.730220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0dc3f-72bd-4144-adf8-ce8b25c95a9a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:24.744879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0dc3f-72bd-4144-adf8-ce8b25c95a9a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:24.750299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fd116-f083-4105-8ff5-07e0616e751a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:24.750939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fd116-f083-4105-8ff5-07e0616e751a service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:24.751219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fd116-f083-4105-8ff5-07e0616e751a service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:24.751519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fd116-f083-4105-8ff5-07e0616e751a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:24.760274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fd116-f083-4105-8ff5-07e0616e751a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:24.761826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fd116-f083-4105-8ff5-07e0616e751a service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:24.771018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 725/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:26.077874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e84a87-0037-4659-a277-d0d28574606c None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:26.078455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e84a87-0037-4659-a277-d0d28574606c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:26.078455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e84a87-0037-4659-a277-d0d28574606c None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:26.079826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 692/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:26.085418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ea23e-15c0-45d2-92d3-1413572d62a9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:26.091520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ea23e-15c0-45d2-92d3-1413572d62a9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:26.091520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ea23e-15c0-45d2-92d3-1413572d62a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:26.103703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7f1ea23e-15c0-45d2-92d3-1413572d62a9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:26.104921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7f1ea23e-15c0-45d2-92d3-1413572d62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:26.112698 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 726/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:23:26.269511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e84a87-0037-4659-a277-d0d28574606c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:26.284645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e84a87-0037-4659-a277-d0d28574606c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:26.290123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c766d3-109a-4933-82f5-dd8539216844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:26.290765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c766d3-109a-4933-82f5-dd8539216844 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:26.291049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c766d3-109a-4933-82f5-dd8539216844 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:26.291330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c766d3-109a-4933-82f5-dd8539216844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:26.299460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c766d3-109a-4933-82f5-dd8539216844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:26.301081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c766d3-109a-4933-82f5-dd8539216844 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:26.310768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 693/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:27.567934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1374-c2f5-4a08-a5bc-d892668d9256 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:27.568980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1374-c2f5-4a08-a5bc-d892668d9256 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:27.568980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1374-c2f5-4a08-a5bc-d892668d9256 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:27.570412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 727/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:27.575399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abbc1-2a31-43e6-a693-2703119217f0 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:27.575822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abbc1-2a31-43e6-a693-2703119217f0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:27.576002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abbc1-2a31-43e6-a693-2703119217f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:27.593967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bd0abbc1-2a31-43e6-a693-2703119217f0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:27.595207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bd0abbc1-2a31-43e6-a693-2703119217f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:27.602816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 694/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:27.750123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb1374-c2f5-4a08-a5bc-d892668d9256 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:27.764523 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb1374-c2f5-4a08-a5bc-d892668d9256 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:27.769749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b77af-1c44-4164-8ea4-c57d2ba1965f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:27.770376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b77af-1c44-4164-8ea4-c57d2ba1965f service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:27.770657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b77af-1c44-4164-8ea4-c57d2ba1965f service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:27.770931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b77af-1c44-4164-8ea4-c57d2ba1965f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:27.779346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b77af-1c44-4164-8ea4-c57d2ba1965f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:27.780940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b77af-1c44-4164-8ea4-c57d2ba1965f service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:27.790050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 728/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:29.033082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed2f3b-ef14-4402-98a4-9f34baa3ee21 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:29.033693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed2f3b-ef14-4402-98a4-9f34baa3ee21 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:29.033693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed2f3b-ef14-4402-98a4-9f34baa3ee21 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:29.034909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 695/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:29.039938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5008-aaf5-490a-9d5c-f6854d0d8aba None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:29.040356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5008-aaf5-490a-9d5c-f6854d0d8aba None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:29.040492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5008-aaf5-490a-9d5c-f6854d0d8aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:29.058004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8e1f5008-aaf5-490a-9d5c-f6854d0d8aba None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:29.059196 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8e1f5008-aaf5-490a-9d5c-f6854d0d8aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:29.066983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 729/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:29.217055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed2f3b-ef14-4402-98a4-9f34baa3ee21 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:29.231101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed2f3b-ef14-4402-98a4-9f34baa3ee21 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:29.236427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746844e-e765-47cd-9d96-257fee8966e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:29.237060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746844e-e765-47cd-9d96-257fee8966e6 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:29.237344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746844e-e765-47cd-9d96-257fee8966e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:29.237621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746844e-e765-47cd-9d96-257fee8966e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:29.246305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746844e-e765-47cd-9d96-257fee8966e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:29.247903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746844e-e765-47cd-9d96-257fee8966e6 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:29.257612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 696/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:30.507006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1f88-c590-4253-9311-ce7e0cf31cd2 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:30.507641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1f88-c590-4253-9311-ce7e0cf31cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:30.507641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1f88-c590-4253-9311-ce7e0cf31cd2 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:30.508973 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 730/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:30.513737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131913ad-9424-4f3a-bd8e-f1d52c717bd5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:30.514187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131913ad-9424-4f3a-bd8e-f1d52c717bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:30.514326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131913ad-9424-4f3a-bd8e-f1d52c717bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:30.532637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-131913ad-9424-4f3a-bd8e-f1d52c717bd5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:30.533845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-131913ad-9424-4f3a-bd8e-f1d52c717bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:30.541614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 697/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:30.695551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1f88-c590-4253-9311-ce7e0cf31cd2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:30.711937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1f88-c590-4253-9311-ce7e0cf31cd2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:30.717394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e0b58-3f4e-4775-acc3-81c5e9da777f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:30.718038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0b58-3f4e-4775-acc3-81c5e9da777f service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:30.718316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0b58-3f4e-4775-acc3-81c5e9da777f service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:30.718597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0b58-3f4e-4775-acc3-81c5e9da777f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:30.727157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e0b58-3f4e-4775-acc3-81c5e9da777f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:30.728804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e0b58-3f4e-4775-acc3-81c5e9da777f service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:30.738763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 731/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:32.039781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ae92a-c748-4f18-815a-934881733072 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:32.040250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ae92a-c748-4f18-815a-934881733072 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:32.040360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ae92a-c748-4f18-815a-934881733072 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:32.041720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 698/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:32.046711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525179-9bd8-4fb9-8ebd-77e83f36fb7d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:32.047175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525179-9bd8-4fb9-8ebd-77e83f36fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:32.047282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525179-9bd8-4fb9-8ebd-77e83f36fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:32.065977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-11525179-9bd8-4fb9-8ebd-77e83f36fb7d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:32.067174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-11525179-9bd8-4fb9-8ebd-77e83f36fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:32.075546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 732/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:32.222257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ae92a-c748-4f18-815a-934881733072 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:32.235977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ae92a-c748-4f18-815a-934881733072 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:32.241663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1193b-7615-471a-bfbf-1f110b34ba2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:32.242293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1193b-7615-471a-bfbf-1f110b34ba2f service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:32.242571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1193b-7615-471a-bfbf-1f110b34ba2f service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:32.242920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1193b-7615-471a-bfbf-1f110b34ba2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:32.250879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1193b-7615-471a-bfbf-1f110b34ba2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:32.252473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1193b-7615-471a-bfbf-1f110b34ba2f service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:32.262337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 699/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:33.563174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595bcd5-8bd2-4863-b6de-b933b53ca97a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:33.563779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595bcd5-8bd2-4863-b6de-b933b53ca97a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:33.563779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595bcd5-8bd2-4863-b6de-b933b53ca97a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:33.565170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 733/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:33.570611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d039b35-8b9b-4b12-94f0-914ce98d6726 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:33.571116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d039b35-8b9b-4b12-94f0-914ce98d6726 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:33.571220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d039b35-8b9b-4b12-94f0-914ce98d6726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:33.589345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0d039b35-8b9b-4b12-94f0-914ce98d6726 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:33.590530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0d039b35-8b9b-4b12-94f0-914ce98d6726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:33.598176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 700/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:33.746604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595bcd5-8bd2-4863-b6de-b933b53ca97a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:33.761609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595bcd5-8bd2-4863-b6de-b933b53ca97a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:33.766883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b23c4-0a2a-478e-ac7c-4632db653069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:33.767545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b23c4-0a2a-478e-ac7c-4632db653069 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:33.767828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b23c4-0a2a-478e-ac7c-4632db653069 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:33.768102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b23c4-0a2a-478e-ac7c-4632db653069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:33.776702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b23c4-0a2a-478e-ac7c-4632db653069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:33.778271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b23c4-0a2a-478e-ac7c-4632db653069 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:33.787738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 734/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:35.079926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c84c2-2464-4abd-ae6e-15e6c407967b None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:35.080472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c84c2-2464-4abd-ae6e-15e6c407967b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:35.080472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c84c2-2464-4abd-ae6e-15e6c407967b None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:35.081835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 701/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:35.089713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde392cf-51a7-4593-b3f6-d9b99836d2c5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:35.090225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde392cf-51a7-4593-b3f6-d9b99836d2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:35.090389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde392cf-51a7-4593-b3f6-d9b99836d2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:35.108948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fde392cf-51a7-4593-b3f6-d9b99836d2c5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:35.110221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fde392cf-51a7-4593-b3f6-d9b99836d2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:35.118961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 735/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:35.273835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c84c2-2464-4abd-ae6e-15e6c407967b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:35.287835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c84c2-2464-4abd-ae6e-15e6c407967b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:35.293216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a37f5-e424-4afe-8396-4d362fb7fe9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:35.293844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a37f5-e424-4afe-8396-4d362fb7fe9b service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:35.294175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a37f5-e424-4afe-8396-4d362fb7fe9b service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:35.294460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a37f5-e424-4afe-8396-4d362fb7fe9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:35.302478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a37f5-e424-4afe-8396-4d362fb7fe9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:35.304561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a37f5-e424-4afe-8396-4d362fb7fe9b service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:35.313554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 702/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:36.606722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f270ad-d9ac-4fb3-be85-fdca779ba1cb None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:36.607291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f270ad-d9ac-4fb3-be85-fdca779ba1cb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:36.607291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f270ad-d9ac-4fb3-be85-fdca779ba1cb None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:36.608681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 736/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:36.613801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce254272-1a5c-4406-8994-813097a35152 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:36.614235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce254272-1a5c-4406-8994-813097a35152 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:36.614383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce254272-1a5c-4406-8994-813097a35152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:36.632381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ce254272-1a5c-4406-8994-813097a35152 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:36.633548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ce254272-1a5c-4406-8994-813097a35152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:36.641154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 703/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:36.790800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f270ad-d9ac-4fb3-be85-fdca779ba1cb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:36.805496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f270ad-d9ac-4fb3-be85-fdca779ba1cb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:36.810862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3e667-35be-4c99-9b93-0a57d9c182d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:36.811498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3e667-35be-4c99-9b93-0a57d9c182d7 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:36.811789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3e667-35be-4c99-9b93-0a57d9c182d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:36.812064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3e667-35be-4c99-9b93-0a57d9c182d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:36.819982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3e667-35be-4c99-9b93-0a57d9c182d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:36.821543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3e667-35be-4c99-9b93-0a57d9c182d7 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:36.830714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 737/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:38.977538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eecf6-5ce8-489d-ade5-7a36cebdd0d5 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:38.978115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eecf6-5ce8-489d-ade5-7a36cebdd0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:38.978115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eecf6-5ce8-489d-ade5-7a36cebdd0d5 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:38.979440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 704/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:38.984719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653c287-d2dd-4122-99c3-1deb951155fe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:38.985133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653c287-d2dd-4122-99c3-1deb951155fe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:38.985252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653c287-d2dd-4122-99c3-1deb951155fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:39.003233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1653c287-d2dd-4122-99c3-1deb951155fe None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:39.004494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1653c287-d2dd-4122-99c3-1deb951155fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:39.012173 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 738/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:39.050279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eecf6-5ce8-489d-ade5-7a36cebdd0d5 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:39.061508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eecf6-5ce8-489d-ade5-7a36cebdd0d5 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:39.064966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa8aac-cce3-4760-b3de-8f5e44dc2f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:39.065638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa8aac-cce3-4760-b3de-8f5e44dc2f62 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:39.065918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa8aac-cce3-4760-b3de-8f5e44dc2f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:39.066197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa8aac-cce3-4760-b3de-8f5e44dc2f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:39.074962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa8aac-cce3-4760-b3de-8f5e44dc2f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:39.076422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa8aac-cce3-4760-b3de-8f5e44dc2f62 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:39.086216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 705/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:41.520089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4b72-3441-46d6-b514-71feb12d851b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:41.520696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4b72-3441-46d6-b514-71feb12d851b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:41.520696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4b72-3441-46d6-b514-71feb12d851b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:41.522022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 739/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:41.527313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cf72-23e2-41bc-87ab-b45339ffd8f3 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:41.527782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cf72-23e2-41bc-87ab-b45339ffd8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:41.528048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cf72-23e2-41bc-87ab-b45339ffd8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:41.545588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c5a4cf72-23e2-41bc-87ab-b45339ffd8f3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:41.546745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c5a4cf72-23e2-41bc-87ab-b45339ffd8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:41.554930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 706/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:41.593131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4b72-3441-46d6-b514-71feb12d851b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:41.603599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4b72-3441-46d6-b514-71feb12d851b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:41.607079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7cfb6-bccc-46b4-92cd-35ca5c2bf295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:41.607743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7cfb6-bccc-46b4-92cd-35ca5c2bf295 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:41.608026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7cfb6-bccc-46b4-92cd-35ca5c2bf295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:41.608339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7cfb6-bccc-46b4-92cd-35ca5c2bf295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:41.617734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7cfb6-bccc-46b4-92cd-35ca5c2bf295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:41.619166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7cfb6-bccc-46b4-92cd-35ca5c2bf295 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:41.628407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 740/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:44.293033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa5dd7-23ab-47ff-aef0-8277dc5d1aaa None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:44.293617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa5dd7-23ab-47ff-aef0-8277dc5d1aaa None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:44.293617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa5dd7-23ab-47ff-aef0-8277dc5d1aaa None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:44.294924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 707/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:44.300072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811caf9-4510-4c1f-89d9-6761aa94f50c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:44.300489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811caf9-4510-4c1f-89d9-6761aa94f50c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:44.300621 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811caf9-4510-4c1f-89d9-6761aa94f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:44.319611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6811caf9-4510-4c1f-89d9-6761aa94f50c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:44.320792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6811caf9-4510-4c1f-89d9-6761aa94f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:44.328711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 741/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:44.366562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa5dd7-23ab-47ff-aef0-8277dc5d1aaa None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:44.377089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa5dd7-23ab-47ff-aef0-8277dc5d1aaa None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:44.381146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88940927-3571-4105-9c1a-9fe61610533f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:44.381774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88940927-3571-4105-9c1a-9fe61610533f service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:44.382055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88940927-3571-4105-9c1a-9fe61610533f service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:44.382333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88940927-3571-4105-9c1a-9fe61610533f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:44.391051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88940927-3571-4105-9c1a-9fe61610533f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:44.392502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88940927-3571-4105-9c1a-9fe61610533f service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:44.401556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 708/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:46.773340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522585f-1abe-43b0-9044-9c31c3c048ea None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:46.773835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522585f-1abe-43b0-9044-9c31c3c048ea None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:46.774064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522585f-1abe-43b0-9044-9c31c3c048ea None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:46.775542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 742/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:46.780617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0c19-97f6-47f0-9de2-429feb0aa239 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:46.781018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0c19-97f6-47f0-9de2-429feb0aa239 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:46.781172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0c19-97f6-47f0-9de2-429feb0aa239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:46.798603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0c3f0c19-97f6-47f0-9de2-429feb0aa239 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:46.799817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0c3f0c19-97f6-47f0-9de2-429feb0aa239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:46.807426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 709/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:46.846746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522585f-1abe-43b0-9044-9c31c3c048ea None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:46.858930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522585f-1abe-43b0-9044-9c31c3c048ea None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:46.862757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd257d-9dfb-4842-94c6-552b5199c78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:46.863399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd257d-9dfb-4842-94c6-552b5199c78d service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:46.863729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd257d-9dfb-4842-94c6-552b5199c78d service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:46.864004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd257d-9dfb-4842-94c6-552b5199c78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:46.873184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd257d-9dfb-4842-94c6-552b5199c78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:46.874589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd257d-9dfb-4842-94c6-552b5199c78d service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:46.884021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 743/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:49.205290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56352c18-fe00-4c7d-ada6-17dc5593e64b None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:49.205866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56352c18-fe00-4c7d-ada6-17dc5593e64b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:49.205866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56352c18-fe00-4c7d-ada6-17dc5593e64b None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:49.207234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 710/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:49.213258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bcdc-90dd-4ca2-84b6-c6703fe3715d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:49.213734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bcdc-90dd-4ca2-84b6-c6703fe3715d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:49.213840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bcdc-90dd-4ca2-84b6-c6703fe3715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:49.231203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5ad0bcdc-90dd-4ca2-84b6-c6703fe3715d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:49.232465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5ad0bcdc-90dd-4ca2-84b6-c6703fe3715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:49.240728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 744/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:49.281709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56352c18-fe00-4c7d-ada6-17dc5593e64b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:49.292822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56352c18-fe00-4c7d-ada6-17dc5593e64b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:49.296367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c3834-ca09-466d-b172-58d937de4339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:49.296997 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c3834-ca09-466d-b172-58d937de4339 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:49.297278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c3834-ca09-466d-b172-58d937de4339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:49.297553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c3834-ca09-466d-b172-58d937de4339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:49.306991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c3834-ca09-466d-b172-58d937de4339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:49.308434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c3834-ca09-466d-b172-58d937de4339 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:49.317706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 711/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:51.603864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc9f5-f056-4d43-82d6-9a7841812da0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:51.604414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc9f5-f056-4d43-82d6-9a7841812da0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:51.604414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc9f5-f056-4d43-82d6-9a7841812da0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:51.605784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 745/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:51.611293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a068-cd2b-413a-bdb7-90967d965889 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:51.611758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a068-cd2b-413a-bdb7-90967d965889 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:51.611888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a068-cd2b-413a-bdb7-90967d965889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:51.629224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a7e8a068-cd2b-413a-bdb7-90967d965889 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:51.630940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a7e8a068-cd2b-413a-bdb7-90967d965889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:51.639105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 712/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:51.676401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc9f5-f056-4d43-82d6-9a7841812da0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:51.686723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc9f5-f056-4d43-82d6-9a7841812da0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:51.690211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01ce92-5c02-4af2-831e-3b06367c037f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:51.690835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01ce92-5c02-4af2-831e-3b06367c037f service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:51.691114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01ce92-5c02-4af2-831e-3b06367c037f service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:51.691415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01ce92-5c02-4af2-831e-3b06367c037f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:51.700651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01ce92-5c02-4af2-831e-3b06367c037f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:51.702075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01ce92-5c02-4af2-831e-3b06367c037f service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:51.712164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 746/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:54.026116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da06187-7d98-43b6-850d-7964ca41657d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:54.026645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da06187-7d98-43b6-850d-7964ca41657d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:54.026645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da06187-7d98-43b6-850d-7964ca41657d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:54.028038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 713/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:54.033398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1e3f-ba84-46ca-a630-9ed9f9b73027 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:54.033809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1e3f-ba84-46ca-a630-9ed9f9b73027 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:54.033952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1e3f-ba84-46ca-a630-9ed9f9b73027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:54.051910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1d4a1e3f-ba84-46ca-a630-9ed9f9b73027 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:54.053630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1d4a1e3f-ba84-46ca-a630-9ed9f9b73027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:54.061508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 747/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:54.099348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da06187-7d98-43b6-850d-7964ca41657d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:54.109922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da06187-7d98-43b6-850d-7964ca41657d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:54.113780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f58249-abd7-4f26-91a9-e4ee63c76e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:54.114476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f58249-abd7-4f26-91a9-e4ee63c76e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:54.114761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f58249-abd7-4f26-91a9-e4ee63c76e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:54.115040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f58249-abd7-4f26-91a9-e4ee63c76e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:54.123816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f58249-abd7-4f26-91a9-e4ee63c76e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:54.125269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f58249-abd7-4f26-91a9-e4ee63c76e28 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:54.134511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 714/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:56.533687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbdde7-a855-44d2-aa5a-68d06f978fff None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:56.534266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbdde7-a855-44d2-aa5a-68d06f978fff None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:56.534266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbdde7-a855-44d2-aa5a-68d06f978fff None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:56.535633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 748/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:56.540849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a436bf-0736-4b8a-bcbf-fa896ab00499 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:56.541269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a436bf-0736-4b8a-bcbf-fa896ab00499 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:56.541412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a436bf-0736-4b8a-bcbf-fa896ab00499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:56.559317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-93a436bf-0736-4b8a-bcbf-fa896ab00499 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:56.560611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-93a436bf-0736-4b8a-bcbf-fa896ab00499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:56.569301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 715/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:23:56.607143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbdde7-a855-44d2-aa5a-68d06f978fff None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:56.618290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbdde7-a855-44d2-aa5a-68d06f978fff None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:56.621802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd01eb-1fd1-4979-9ed2-867f683bc128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:56.622415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd01eb-1fd1-4979-9ed2-867f683bc128 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:56.622693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd01eb-1fd1-4979-9ed2-867f683bc128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:56.622963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd01eb-1fd1-4979-9ed2-867f683bc128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:56.632274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd01eb-1fd1-4979-9ed2-867f683bc128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:56.633831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd01eb-1fd1-4979-9ed2-867f683bc128 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:56.644057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 749/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:23:58.947952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e3ac-f939-40eb-b34b-a1eeaed88e8c None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:58.948520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e3ac-f939-40eb-b34b-a1eeaed88e8c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:58.948520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e3ac-f939-40eb-b34b-a1eeaed88e8c None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:58.949857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 716/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:23:58.955285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0831-5ac5-4ee4-8e8e-8f2c0b50acbd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:58.955765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0831-5ac5-4ee4-8e8e-8f2c0b50acbd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:58.955862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0831-5ac5-4ee4-8e8e-8f2c0b50acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:58.974397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a93a0831-5ac5-4ee4-8e8e-8f2c0b50acbd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:23:58.975632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a93a0831-5ac5-4ee4-8e8e-8f2c0b50acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:23:58.983517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 750/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:23:59.020804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750e3ac-f939-40eb-b34b-a1eeaed88e8c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:23:59.031560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750e3ac-f939-40eb-b34b-a1eeaed88e8c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:23:59.035253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61147cbc-d54d-46bf-9e1c-d2d84ab6c7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:23:59.036442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147cbc-d54d-46bf-9e1c-d2d84ab6c7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:23:59.036722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147cbc-d54d-46bf-9e1c-d2d84ab6c7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:23:59.036998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147cbc-d54d-46bf-9e1c-d2d84ab6c7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:23:59.045800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61147cbc-d54d-46bf-9e1c-d2d84ab6c7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:23:59.047212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61147cbc-d54d-46bf-9e1c-d2d84ab6c7c0 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:23:59.056900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 717/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:01.343486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766640c9-4b7a-4731-81a5-521d5ca4dfd9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:01.344059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766640c9-4b7a-4731-81a5-521d5ca4dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:01.344478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766640c9-4b7a-4731-81a5-521d5ca4dfd9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:01.346743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 751/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:01.352127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc3a44-e069-4074-9d69-c25f98a0f09e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:01.352579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc3a44-e069-4074-9d69-c25f98a0f09e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:01.352705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc3a44-e069-4074-9d69-c25f98a0f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:01.370695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-77fc3a44-e069-4074-9d69-c25f98a0f09e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:01.372125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-77fc3a44-e069-4074-9d69-c25f98a0f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:01.380891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 718/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:01.417114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766640c9-4b7a-4731-81a5-521d5ca4dfd9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:01.427841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766640c9-4b7a-4731-81a5-521d5ca4dfd9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:01.431382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c3af4-46a7-4dd7-96dc-1b6ddfe48fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:01.432060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c3af4-46a7-4dd7-96dc-1b6ddfe48fde service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:01.432346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c3af4-46a7-4dd7-96dc-1b6ddfe48fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:01.432625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c3af4-46a7-4dd7-96dc-1b6ddfe48fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:01.441372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c3af4-46a7-4dd7-96dc-1b6ddfe48fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:01.443341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c3af4-46a7-4dd7-96dc-1b6ddfe48fde service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:01.455267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 752/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:35.306821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2820-9bc5-4acd-a3ea-96b3f1fa17e4 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:35.307492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2820-9bc5-4acd-a3ea-96b3f1fa17e4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:35.307492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2820-9bc5-4acd-a3ea-96b3f1fa17e4 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:35.308805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 719/1471] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:35.314035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b32a-1874-46f5-8ca0-ac1f0dd31120 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:35.314485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b32a-1874-46f5-8ca0-ac1f0dd31120 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:35.314600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b32a-1874-46f5-8ca0-ac1f0dd31120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:35.332362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f462b32a-1874-46f5-8ca0-ac1f0dd31120 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:35.333572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f462b32a-1874-46f5-8ca0-ac1f0dd31120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:35.341452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 753/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:35.388165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbb1b-d3a0-49a8-a4ab-df35bb6fffe1 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:35.388457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbb1b-d3a0-49a8-a4ab-df35bb6fffe1 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:35.388735 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbb1b-d3a0-49a8-a4ab-df35bb6fffe1 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:35.390073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 720/1473] 10.222.0.55 () {54 vars in 962 bytes} [Thu May 5 15:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:35.394843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe89f-75b3-4235-8435-aabc88357aeb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:35.395126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe89f-75b3-4235-8435-aabc88357aeb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:35.395401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe89f-75b3-4235-8435-aabc88357aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:35.413074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a5abe89f-75b3-4235-8435-aabc88357aeb None None] MFA Rules not processed for user `fc69b41ea4d6456f9532cee386265e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:35.414273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a5abe89f-75b3-4235-8435-aabc88357aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:35.420745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 754/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Thu May 5 15:24:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:35.428811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccbb1b-d3a0-49a8-a4ab-df35bb6fffe1 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:35.441270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccbb1b-d3a0-49a8-a4ab-df35bb6fffe1 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:35.446884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f577d-084b-4e4d-8b3f-b64774279d5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc69b41ea4d6456f9532cee386265e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:35.446884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f577d-084b-4e4d-8b3f-b64774279d5c service glance] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:35.446884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f577d-084b-4e4d-8b3f-b64774279d5c service glance] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:35.446884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f577d-084b-4e4d-8b3f-b64774279d5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:35.454767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f577d-084b-4e4d-8b3f-b64774279d5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:35.456280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f577d-084b-4e4d-8b3f-b64774279d5c service glance] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:35.465817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 721/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:37.990387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2016-7744-410e-9a01-c8a093ba9382 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:37.990930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2016-7744-410e-9a01-c8a093ba9382 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:37.990930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2016-7744-410e-9a01-c8a093ba9382 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:37.992407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 755/1476] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:37.998360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0974-8a3b-4357-a4c5-31c8b5ce4794 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:37.998819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0974-8a3b-4357-a4c5-31c8b5ce4794 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:37.998993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0974-8a3b-4357-a4c5-31c8b5ce4794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:38.016549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e2db0974-8a3b-4357-a4c5-31c8b5ce4794 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:38.017668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e2db0974-8a3b-4357-a4c5-31c8b5ce4794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:38.025988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 722/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:38.048765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e2016-7744-410e-9a01-c8a093ba9382 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:38.061053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e2016-7744-410e-9a01-c8a093ba9382 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:38.066131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb18654-be1e-4fde-92f4-f6c858bdfacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:38.066772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb18654-be1e-4fde-92f4-f6c858bdfacb admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:38.067054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb18654-be1e-4fde-92f4-f6c858bdfacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:38.067331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb18654-be1e-4fde-92f4-f6c858bdfacb admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:38.068087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb18654-be1e-4fde-92f4-f6c858bdfacb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:38.069883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-4eb18654-be1e-4fde-92f4-f6c858bdfacb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:24:38.069883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:24:38.069883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:24:38.071029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb18654-be1e-4fde-92f4-f6c858bdfacb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:38.090648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 756/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Thu May 5 15:24:38 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:24:40.366541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e885d7f-e50e-458a-8603-61efebb8eef3 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:40.367115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e885d7f-e50e-458a-8603-61efebb8eef3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:40.367115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e885d7f-e50e-458a-8603-61efebb8eef3 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:40.368475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 723/1479] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:40.373745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba3c94-0d6e-4fee-b855-f035fcf6091c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:40.374184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba3c94-0d6e-4fee-b855-f035fcf6091c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:40.374302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba3c94-0d6e-4fee-b855-f035fcf6091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:40.392801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fdba3c94-0d6e-4fee-b855-f035fcf6091c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:40.394596 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fdba3c94-0d6e-4fee-b855-f035fcf6091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:40.402724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 757/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:40.444539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e885d7f-e50e-458a-8603-61efebb8eef3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:40.458852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e885d7f-e50e-458a-8603-61efebb8eef3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:40.464487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a4840-2945-41e6-999b-2b955852d966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:40.464813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a4840-2945-41e6-999b-2b955852d966 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:40.465104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a4840-2945-41e6-999b-2b955852d966 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:40.465368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a4840-2945-41e6-999b-2b955852d966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:40.473754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a4840-2945-41e6-999b-2b955852d966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:40.475330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a4840-2945-41e6-999b-2b955852d966 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:40.484415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 724/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:42.928326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2af71-b3b2-4ef6-925e-c78fe40c5b64 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:42.928928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2af71-b3b2-4ef6-925e-c78fe40c5b64 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:42.928928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2af71-b3b2-4ef6-925e-c78fe40c5b64 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:42.930269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 758/1482] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:42.935558 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474569e4-bb25-49af-ae43-d865851fb1d3 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:42.940653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474569e4-bb25-49af-ae43-d865851fb1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:42.940653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474569e4-bb25-49af-ae43-d865851fb1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:42.954528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-474569e4-bb25-49af-ae43-d865851fb1d3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:42.955695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-474569e4-bb25-49af-ae43-d865851fb1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:42.963366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 725/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:43.006245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2af71-b3b2-4ef6-925e-c78fe40c5b64 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:43.010732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2af71-b3b2-4ef6-925e-c78fe40c5b64 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:43.014229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbef1e-e4fa-4a6c-8dbd-7ab52ddef61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:43.014855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbef1e-e4fa-4a6c-8dbd-7ab52ddef61c service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:43.015132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbef1e-e4fa-4a6c-8dbd-7ab52ddef61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:43.015402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbef1e-e4fa-4a6c-8dbd-7ab52ddef61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:43.024386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbef1e-e4fa-4a6c-8dbd-7ab52ddef61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:43.025807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbef1e-e4fa-4a6c-8dbd-7ab52ddef61c service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:43.035442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 759/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:45.346578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0d83-901a-415b-8a5f-ee33c25ef59d None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:45.347167 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0d83-901a-415b-8a5f-ee33c25ef59d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:45.347167 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0d83-901a-415b-8a5f-ee33c25ef59d None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:45.348539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 726/1485] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:45.353724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6952-423d-450a-9a96-1c026f892dba None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:45.354150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6952-423d-450a-9a96-1c026f892dba None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:45.354271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6952-423d-450a-9a96-1c026f892dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:45.371797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-823e6952-423d-450a-9a96-1c026f892dba None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:45.373002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-823e6952-423d-450a-9a96-1c026f892dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:45.380637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 760/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:45.418917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df0d83-901a-415b-8a5f-ee33c25ef59d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:45.429499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df0d83-901a-415b-8a5f-ee33c25ef59d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:45.433011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7afa55-205e-48e6-869d-90090728ccfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:45.433642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7afa55-205e-48e6-869d-90090728ccfc service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:45.433928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7afa55-205e-48e6-869d-90090728ccfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:45.434208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7afa55-205e-48e6-869d-90090728ccfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:45.443543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7afa55-205e-48e6-869d-90090728ccfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:45.444957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7afa55-205e-48e6-869d-90090728ccfc service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:45.454078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 727/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:47.858314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3b18-fa50-4a68-bd41-50ca3d12017e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:47.858887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3b18-fa50-4a68-bd41-50ca3d12017e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:47.858887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3b18-fa50-4a68-bd41-50ca3d12017e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:47.860540 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 761/1488] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:47.866340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac7d4f-414e-4d0c-b5c7-0d4923041622 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:47.866762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac7d4f-414e-4d0c-b5c7-0d4923041622 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:47.866903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac7d4f-414e-4d0c-b5c7-0d4923041622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:47.884280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-37ac7d4f-414e-4d0c-b5c7-0d4923041622 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:47.885495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-37ac7d4f-414e-4d0c-b5c7-0d4923041622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:47.893255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 728/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:24:47.933454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3b18-fa50-4a68-bd41-50ca3d12017e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:47.944056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3b18-fa50-4a68-bd41-50ca3d12017e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:47.947554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee3ad9-5cbc-4868-aef4-f83b29916434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:47.948188 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee3ad9-5cbc-4868-aef4-f83b29916434 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:47.948471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee3ad9-5cbc-4868-aef4-f83b29916434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:47.948796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee3ad9-5cbc-4868-aef4-f83b29916434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:47.957694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee3ad9-5cbc-4868-aef4-f83b29916434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:47.959120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee3ad9-5cbc-4868-aef4-f83b29916434 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:47.968566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 762/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:50.700838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e429fd-a004-4e2e-bc5d-18a603e17093 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:50.701431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e429fd-a004-4e2e-bc5d-18a603e17093 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:50.701431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e429fd-a004-4e2e-bc5d-18a603e17093 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:50.702888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 729/1491] 10.222.0.55 () {54 vars in 926 bytes} [Thu May 5 15:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:50.708703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2dcdf-b635-4c3a-8ac9-8d90b70ae18b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:50.709152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2dcdf-b635-4c3a-8ac9-8d90b70ae18b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:50.709257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2dcdf-b635-4c3a-8ac9-8d90b70ae18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:50.727025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-29a2dcdf-b635-4c3a-8ac9-8d90b70ae18b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:50.728175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-29a2dcdf-b635-4c3a-8ac9-8d90b70ae18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:50.736692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 763/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Thu May 5 15:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:50.775723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e429fd-a004-4e2e-bc5d-18a603e17093 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:50.787204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e429fd-a004-4e2e-bc5d-18a603e17093 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:50.792368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10969f24-bc7c-4f1e-95eb-a9f8c672e2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:50.793012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10969f24-bc7c-4f1e-95eb-a9f8c672e2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:50.793294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10969f24-bc7c-4f1e-95eb-a9f8c672e2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:50.793571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10969f24-bc7c-4f1e-95eb-a9f8c672e2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:50.802729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10969f24-bc7c-4f1e-95eb-a9f8c672e2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:50.804188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10969f24-bc7c-4f1e-95eb-a9f8c672e2e1 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:50.813427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 730/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:47.583182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ca2b-e6bc-4c16-95f7-2aaabdf8945b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:47.583827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ca2b-e6bc-4c16-95f7-2aaabdf8945b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:47.583827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ca2b-e6bc-4c16-95f7-2aaabdf8945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:47.601337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-19b8ca2b-e6bc-4c16-95f7-2aaabdf8945b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:47.602529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-19b8ca2b-e6bc-4c16-95f7-2aaabdf8945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:47.611220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 764/1494] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:47.618856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe69a-6fce-4b9e-81e2-a601cc78da88 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:47.619363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe69a-6fce-4b9e-81e2-a601cc78da88 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:47.619550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe69a-6fce-4b9e-81e2-a601cc78da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:47.637471 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7b4fe69a-6fce-4b9e-81e2-a601cc78da88 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:47.638688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7b4fe69a-6fce-4b9e-81e2-a601cc78da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:47.646649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 731/1495] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:47.651161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8ca2b-e6bc-4c16-95f7-2aaabdf8945b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:47.660900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8ca2b-e6bc-4c16-95f7-2aaabdf8945b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:47.665866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:47.667035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:47.667315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:47.667627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:47.668374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:26:47.668679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:47.669751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:47.669751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:26:47.669751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:26:47.670637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:47.682684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 765/1496] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:26:47.690901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fe69a-6fce-4b9e-81e2-a601cc78da88 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:47.699971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fe69a-6fce-4b9e-81e2-a601cc78da88 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:47.704554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:47.705202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:47.705483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:47.705756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:47.706452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:47.708238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING py.warnings [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:47.708238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: warnings.warn(msg) May 05 15:26:47.708238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: May 05 15:26:47.709433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:47.838059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 732/1497] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:26:47 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:26:47.842157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:47.852431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94be4b-1fa9-4de8-9f9a-0a42561066c3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:47.906502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:47.907158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:47.907513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:47.907782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:47.908459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:47.909468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:47.909468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:26:47.909468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:26:47.910678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:47.988433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 766/1498] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:26:47 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:26:47.992632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:48.002932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb87f9-f05f-4470-bcae-c3b960eafdb8 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:48.007352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:48.008080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:48.008368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:48.008643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:48.009367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:48.010381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING py.warnings [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:48.010381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: warnings.warn(msg) May 05 15:26:48.010381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: May 05 15:26:48.011252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:48.023767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 733/1499] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:26:48.028259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:48.038000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321eef0-bc0e-470b-ad40-9779664068cf admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:48.043262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252fae1-2189-4eac-95cd-47f1dac48b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:48.043942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252fae1-2189-4eac-95cd-47f1dac48b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:48.044228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252fae1-2189-4eac-95cd-47f1dac48b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:48.044505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252fae1-2189-4eac-95cd-47f1dac48b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:48.045224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252fae1-2189-4eac-95cd-47f1dac48b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:48.046258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-7252fae1-2189-4eac-95cd-47f1dac48b21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:48.046258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:26:48.046258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:26:48.047152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252fae1-2189-4eac-95cd-47f1dac48b21 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:48.061200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 767/1500] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:26:48.065466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:48.075331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300167d-f317-4279-a058-aff3c1f9343d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:48.079941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:48.080821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:48.081102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:48.081382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] PATH_INFO: `/v3/projects/ef085663d9ac46f0918eeb1190e05af9/users/ccc46265edb74f9bb826682451aa08c4/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:48.097146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef085663d9ac46f0918eeb1190e05af9, user_id=ccc46265edb74f9bb826682451aa08c4, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:48.098084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING py.warnings [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:48.098084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: warnings.warn(msg) May 05 15:26:48.098084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: May 05 15:26:48.100039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:48.215980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 734/1501] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:26:48 2022] PUT /identity/v3/projects/ef085663d9ac46f0918eeb1190e05af9/users/ccc46265edb74f9bb826682451aa08c4/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:26:48.227398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697daa47-2c18-4c16-ba20-645e1801a241 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:48.227726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697daa47-2c18-4c16-ba20-645e1801a241 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:48.229358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697daa47-2c18-4c16-ba20-645e1801a241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:48.253892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-697daa47-2c18-4c16-ba20-645e1801a241 None None] MFA Rules not processed for user `ccc46265edb74f9bb826682451aa08c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:48.255115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-697daa47-2c18-4c16-ba20-645e1801a241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:48.317409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 768/1502] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:48.328814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:48.396794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd497709-d833-4be9-ae0b-7bd7c27e363a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:48.402698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:48.403349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:48.403664 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:48.403942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:48.411557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:48.413155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:48.421763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 735/1503] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:26:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:48.493860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a2f6-3644-44b7-aec6-4c30277e4935 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:48.494151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a2f6-3644-44b7-aec6-4c30277e4935 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:48.494936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a2f6-3644-44b7-aec6-4c30277e4935 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:48.496242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 769/1504] 10.222.0.55 () {52 vars in 829 bytes} [Thu May 5 15:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:48.499984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:48.560470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79464-5ffe-42b7-95d8-339e178a6ad7 service nova] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:48.565362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:48.566238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:48.566529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:48.566808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] PATH_INFO: `/v3/users/ccc46265edb74f9bb826682451aa08c4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:48.568031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc46265edb74f9bb826682451aa08c4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:48.569049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING py.warnings [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:48.569049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: warnings.warn(msg) May 05 15:26:48.569049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: May 05 15:26:48.570299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:48.888168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc46265edb74f9bb826682451aa08c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:48.901476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc46265edb74f9bb826682451aa08c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:49.032281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc46265edb74f9bb826682451aa08c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:49.051695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc46265edb74f9bb826682451aa08c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:49.052466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc46265edb74f9bb826682451aa08c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:49.059141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 736/1505] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:26:48 2022] DELETE /identity/v3/users/ccc46265edb74f9bb826682451aa08c4 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:26:49.063951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:49.064438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:49.064438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:49.082022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:49.086945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:49.140903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 770/1506] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:49.150709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:49.152188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:49.211136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e29d10-0179-47cd-9b84-f71353b7c5f9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:49.215413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ad8e-55df-48ea-96fa-1f7b5722f313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:49.216092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ad8e-55df-48ea-96fa-1f7b5722f313 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:49.216379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ad8e-55df-48ea-96fa-1f7b5722f313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:49.216657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ad8e-55df-48ea-96fa-1f7b5722f313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:49.226007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ad8e-55df-48ea-96fa-1f7b5722f313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:49.227638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ad8e-55df-48ea-96fa-1f7b5722f313 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:49.237405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 737/1507] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:49.788091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:49.789523 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:49.801388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe88aaa-7195-4479-a664-9271a47a8588 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:49.806052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:49.807574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:49.807883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:49.808242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] PATH_INFO: `/v3/projects/ef085663d9ac46f0918eeb1190e05af9` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:49.809536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef085663d9ac46f0918eeb1190e05af9)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:49.810557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:26:49.810557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:26:49.810557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:26:49.811838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:49.937120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef085663d9ac46f0918eeb1190e05af9', 'request_id': 'req-890ad295-3442-4a9b-b837-0b6dbb279656'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:49.950569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef085663d9ac46f0918eeb1190e05af9', 'request_id': 'req-890ad295-3442-4a9b-b837-0b6dbb279656'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:50.043723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef085663d9ac46f0918eeb1190e05af9', 'request_id': 'req-890ad295-3442-4a9b-b837-0b6dbb279656'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:50.054903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] The token cache is being invalidate because project ef085663d9ac46f0918eeb1190e05af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:26:50.055188 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:50.055944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-890ad295-3442-4a9b-b837-0b6dbb279656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:26:50.057511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 771/1508] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:26:49 2022] DELETE /identity/v3/projects/ef085663d9ac46f0918eeb1190e05af9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:29.278734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bcf93-4c1d-41c3-88df-984715bdafe4 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.279397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bcf93-4c1d-41c3-88df-984715bdafe4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.279768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bcf93-4c1d-41c3-88df-984715bdafe4 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.282772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 738/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:28:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:29.288249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f98d-f348-4e16-97bc-82c21fd3eac7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.288836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f98d-f348-4e16-97bc-82c21fd3eac7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.288836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f98d-f348-4e16-97bc-82c21fd3eac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.308175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b279f98d-f348-4e16-97bc-82c21fd3eac7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:29.309429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b279f98d-f348-4e16-97bc-82c21fd3eac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:29.374296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 772/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:29.544863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bcf93-4c1d-41c3-88df-984715bdafe4 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:29.546618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6f7bcf93-4c1d-41c3-88df-984715bdafe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:29.803184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9a42-2b93-4ffb-96b5-4a48c254761c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.803663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9a42-2b93-4ffb-96b5-4a48c254761c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.804054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bcf93-4c1d-41c3-88df-984715bdafe4 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.804236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9a42-2b93-4ffb-96b5-4a48c254761c None None] PATH_INFO: `/v3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.805667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 773/1511] 10.222.0.60 () {54 vars in 925 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:29.811834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744238a4-c740-4cc6-99d1-9c687f143f63 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.812283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744238a4-c740-4cc6-99d1-9c687f143f63 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.812663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744238a4-c740-4cc6-99d1-9c687f143f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.813965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f0ac9-a44d-4f57-9720-f82e073a8cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.815092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0ac9-a44d-4f57-9720-f82e073a8cf4 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.815655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0ac9-a44d-4f57-9720-f82e073a8cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.816337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0ac9-a44d-4f57-9720-f82e073a8cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.831733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f0ac9-a44d-4f57-9720-f82e073a8cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.833436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f0ac9-a44d-4f57-9720-f82e073a8cf4 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.833706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-744238a4-c740-4cc6-99d1-9c687f143f63 None None] MFA Rules not processed for user `4b8520e6db2346c59a1230380c515703`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:29.835317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-744238a4-c740-4cc6-99d1-9c687f143f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:29.849260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 739/1512] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:29.914489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 774/1513] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 5 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:28:31.170394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168216-098b-443c-867c-946bf1b42604 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.233148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168216-098b-443c-867c-946bf1b42604 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.233148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168216-098b-443c-867c-946bf1b42604 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.233148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 740/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:31.234202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49d611-f68c-41cb-a5a8-4f49a17b5065 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.234202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49d611-f68c-41cb-a5a8-4f49a17b5065 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.234202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49d611-f68c-41cb-a5a8-4f49a17b5065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.234202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9c49d611-f68c-41cb-a5a8-4f49a17b5065 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:31.234202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9c49d611-f68c-41cb-a5a8-4f49a17b5065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:31.234202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 775/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:31.363749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168216-098b-443c-867c-946bf1b42604 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.379102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168216-098b-443c-867c-946bf1b42604 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.384827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fa75f-7ba1-42dc-8a34-baff94afb900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.385479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fa75f-7ba1-42dc-8a34-baff94afb900 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.385761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fa75f-7ba1-42dc-8a34-baff94afb900 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.386047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fa75f-7ba1-42dc-8a34-baff94afb900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.394980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fa75f-7ba1-42dc-8a34-baff94afb900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.396610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fa75f-7ba1-42dc-8a34-baff94afb900 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.406445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 741/1516] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:28:34.008028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890ee8-bfa3-476c-b600-69e354fd9964 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.008631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890ee8-bfa3-476c-b600-69e354fd9964 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.008631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890ee8-bfa3-476c-b600-69e354fd9964 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.009867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 776/1517] 10.222.0.55 () {54 vars in 960 bytes} [Thu May 5 15:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:34.016330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1f36-ef70-45a5-8368-c5498c75f53d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.017153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1f36-ef70-45a5-8368-c5498c75f53d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.017365 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1f36-ef70-45a5-8368-c5498c75f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.035893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-af7a1f36-ef70-45a5-8368-c5498c75f53d None None] MFA Rules not processed for user `4b8520e6db2346c59a1230380c515703`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:34.037121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-af7a1f36-ef70-45a5-8368-c5498c75f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:34.045977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 742/1518] 10.222.0.55 () {58 vars in 1057 bytes} [Thu May 5 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:34.053911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890ee8-bfa3-476c-b600-69e354fd9964 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.068116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890ee8-bfa3-476c-b600-69e354fd9964 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:34.073123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472696d7-3b0e-4f7f-9ea9-f88ff588b60a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:34.073780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472696d7-3b0e-4f7f-9ea9-f88ff588b60a service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.074067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472696d7-3b0e-4f7f-9ea9-f88ff588b60a service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.074347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472696d7-3b0e-4f7f-9ea9-f88ff588b60a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.084437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472696d7-3b0e-4f7f-9ea9-f88ff588b60a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:34.086133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472696d7-3b0e-4f7f-9ea9-f88ff588b60a service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:34.097145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 777/1519] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:43.111639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43ebe3-d0f3-4e0e-929c-7cfcffa34a9c None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.112196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43ebe3-d0f3-4e0e-929c-7cfcffa34a9c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.112196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43ebe3-d0f3-4e0e-929c-7cfcffa34a9c None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.113630 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 743/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:43.118711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f8e47-1788-4ca3-9c69-a254b3f3c6a0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.119154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f8e47-1788-4ca3-9c69-a254b3f3c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.119267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f8e47-1788-4ca3-9c69-a254b3f3c6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.136852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-419f8e47-1788-4ca3-9c69-a254b3f3c6a0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:43.138049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-419f8e47-1788-4ca3-9c69-a254b3f3c6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:43.145906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 778/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:43.309910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43ebe3-d0f3-4e0e-929c-7cfcffa34a9c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.324579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43ebe3-d0f3-4e0e-929c-7cfcffa34a9c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.331225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666e19a-7424-49a7-a5ba-9638973f0e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.331898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e19a-7424-49a7-a5ba-9638973f0e9f service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.332183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e19a-7424-49a7-a5ba-9638973f0e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.332460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e19a-7424-49a7-a5ba-9638973f0e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.340602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666e19a-7424-49a7-a5ba-9638973f0e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.342237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666e19a-7424-49a7-a5ba-9638973f0e9f service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.352719 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 744/1522] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:44.635395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8046f2-3180-4e23-850e-0d032b4bbfd1 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.636004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8046f2-3180-4e23-850e-0d032b4bbfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.636004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8046f2-3180-4e23-850e-0d032b4bbfd1 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.637362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 779/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:44.642982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a23a-cd56-4edc-ab49-f7cb071ac3d5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.643487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a23a-cd56-4edc-ab49-f7cb071ac3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.643585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a23a-cd56-4edc-ab49-f7cb071ac3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.662140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ead7a23a-cd56-4edc-ab49-f7cb071ac3d5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:44.663370 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ead7a23a-cd56-4edc-ab49-f7cb071ac3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:44.671501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 745/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:44.826833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8046f2-3180-4e23-850e-0d032b4bbfd1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:44.842365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8046f2-3180-4e23-850e-0d032b4bbfd1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.848733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fdda8-d872-41b8-99d5-584cbda0a9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.849407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fdda8-d872-41b8-99d5-584cbda0a9d7 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.849690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fdda8-d872-41b8-99d5-584cbda0a9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.850230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fdda8-d872-41b8-99d5-584cbda0a9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.859165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fdda8-d872-41b8-99d5-584cbda0a9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.860819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fdda8-d872-41b8-99d5-584cbda0a9d7 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.871012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 780/1525] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:49.125305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829095fa-4ae2-4375-a9c5-250c0598119f None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.126803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829095fa-4ae2-4375-a9c5-250c0598119f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.126803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829095fa-4ae2-4375-a9c5-250c0598119f None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.128818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 746/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:28:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:49.134503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895a52-cc7e-4c67-9d05-5691b6d28a35 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.135039 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895a52-cc7e-4c67-9d05-5691b6d28a35 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.135159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895a52-cc7e-4c67-9d05-5691b6d28a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.153671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-73895a52-cc7e-4c67-9d05-5691b6d28a35 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:49.154871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-73895a52-cc7e-4c67-9d05-5691b6d28a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:49.163073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 781/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:49.205910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829095fa-4ae2-4375-a9c5-250c0598119f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.205910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-829095fa-4ae2-4375-a9c5-250c0598119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:49.262749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829095fa-4ae2-4375-a9c5-250c0598119f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.266410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e69dd4-7a2e-4658-a69b-90b422e0403a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.267631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e69dd4-7a2e-4658-a69b-90b422e0403a service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.267915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e69dd4-7a2e-4658-a69b-90b422e0403a service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.268193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e69dd4-7a2e-4658-a69b-90b422e0403a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.277521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e69dd4-7a2e-4658-a69b-90b422e0403a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:49.278954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e69dd4-7a2e-4658-a69b-90b422e0403a service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:49.288910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 747/1528] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:51.591440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7410-a507-4e36-881c-6e33d2b392fe None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.592062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7410-a507-4e36-881c-6e33d2b392fe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.592062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7410-a507-4e36-881c-6e33d2b392fe None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.593398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 782/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:51.599302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f011fa-c726-4771-b436-1767083c1f6d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.600142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f011fa-c726-4771-b436-1767083c1f6d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.600142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f011fa-c726-4771-b436-1767083c1f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.618119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a8f011fa-c726-4771-b436-1767083c1f6d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:51.619329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a8f011fa-c726-4771-b436-1767083c1f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:51.627249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 748/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:28:51.664168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7410-a507-4e36-881c-6e33d2b392fe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:51.675116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7410-a507-4e36-881c-6e33d2b392fe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:51.678710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733dd94-cd51-4ec2-94d9-3505bdf4c3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:51.679349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733dd94-cd51-4ec2-94d9-3505bdf4c3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.679659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733dd94-cd51-4ec2-94d9-3505bdf4c3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.679944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733dd94-cd51-4ec2-94d9-3505bdf4c3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.689718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733dd94-cd51-4ec2-94d9-3505bdf4c3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:51.691166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733dd94-cd51-4ec2-94d9-3505bdf4c3f0 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:51.701321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 783/1531] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:55.541658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002831-e3b2-40af-8417-9043d16c0cba None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:55.542251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002831-e3b2-40af-8417-9043d16c0cba None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:55.542251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002831-e3b2-40af-8417-9043d16c0cba None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:55.543597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 749/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:55.549573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efc0e-54ec-4fec-a8d7-63a445f5401c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:55.550185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efc0e-54ec-4fec-a8d7-63a445f5401c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:55.550185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efc0e-54ec-4fec-a8d7-63a445f5401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:55.569153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-429efc0e-54ec-4fec-a8d7-63a445f5401c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:55.570407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-429efc0e-54ec-4fec-a8d7-63a445f5401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:55.579045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 784/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:55.859242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002831-e3b2-40af-8417-9043d16c0cba None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:55.860996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e2002831-e3b2-40af-8417-9043d16c0cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:55.919017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002831-e3b2-40af-8417-9043d16c0cba None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:55.922572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18348a68-132f-4354-b000-66e7f3ad4cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:55.923218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348a68-132f-4354-b000-66e7f3ad4cae service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:55.923525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348a68-132f-4354-b000-66e7f3ad4cae service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:55.923804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348a68-132f-4354-b000-66e7f3ad4cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:55.933027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18348a68-132f-4354-b000-66e7f3ad4cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:55.934467 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18348a68-132f-4354-b000-66e7f3ad4cae service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:55.944278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 750/1534] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:58.280306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e29eca-dea2-49cd-b64d-fa8c197df1c4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.280886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e29eca-dea2-49cd-b64d-fa8c197df1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.280886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e29eca-dea2-49cd-b64d-fa8c197df1c4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.282769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 785/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:58.288191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc16e45-a0b1-463c-bb97-12537da130f6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.288628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc16e45-a0b1-463c-bb97-12537da130f6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.288744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc16e45-a0b1-463c-bb97-12537da130f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.307012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8fc16e45-a0b1-463c-bb97-12537da130f6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:58.308232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8fc16e45-a0b1-463c-bb97-12537da130f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:58.317174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 751/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:58.594055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef15ebc-94f9-4d1f-9de2-397e2ebc8aef None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.594879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef15ebc-94f9-4d1f-9de2-397e2ebc8aef None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.595159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef15ebc-94f9-4d1f-9de2-397e2ebc8aef None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.596573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 786/1537] 10.222.0.55 () {54 vars in 963 bytes} [Thu May 5 15:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:58.602192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cffbe3-74cc-4062-8687-e80456a05894 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.602480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cffbe3-74cc-4062-8687-e80456a05894 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.602760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cffbe3-74cc-4062-8687-e80456a05894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.621286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-22cffbe3-74cc-4062-8687-e80456a05894 None None] MFA Rules not processed for user `fd89045deca342e5a4a6fa39c5bde4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:58.622525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-22cffbe3-74cc-4062-8687-e80456a05894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:58.629636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 752/1538] 10.222.0.55 () {58 vars in 1060 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:58.637423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef15ebc-94f9-4d1f-9de2-397e2ebc8aef None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.648514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef15ebc-94f9-4d1f-9de2-397e2ebc8aef None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.652079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509abb9-437c-4008-b006-eb55e6a6fa2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.652720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509abb9-437c-4008-b006-eb55e6a6fa2e service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.653004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509abb9-437c-4008-b006-eb55e6a6fa2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.653285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509abb9-437c-4008-b006-eb55e6a6fa2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.663742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509abb9-437c-4008-b006-eb55e6a6fa2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.665170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509abb9-437c-4008-b006-eb55e6a6fa2e service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.674914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 787/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:32.309462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbebd7-9d64-48bc-a22b-73724f676d91 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.309462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbebd7-9d64-48bc-a22b-73724f676d91 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.309462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbebd7-9d64-48bc-a22b-73724f676d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.337066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c4bbebd7-9d64-48bc-a22b-73724f676d91 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:32.338234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c4bbebd7-9d64-48bc-a22b-73724f676d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:32.356061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 753/1540] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:32.370162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b78c51-66e9-442a-92bb-1e8e9a19a4f1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.372215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3f4e-afa4-4319-9871-f74af3ceaa26 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.372215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3f4e-afa4-4319-9871-f74af3ceaa26 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.372433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3f4e-afa4-4319-9871-f74af3ceaa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.373338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b78c51-66e9-442a-92bb-1e8e9a19a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.373858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b78c51-66e9-442a-92bb-1e8e9a19a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.404647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ff4c3f4e-afa4-4319-9871-f74af3ceaa26 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:32.407640 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ff4c3f4e-afa4-4319-9871-f74af3ceaa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:32.410877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c5b78c51-66e9-442a-92bb-1e8e9a19a4f1 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:32.416478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c5b78c51-66e9-442a-92bb-1e8e9a19a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:32.425372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 754/1541] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:30:32.436358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 788/1542] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:32.441799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958227d6-49c2-4f68-9b88-7a9e4e0b6925 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.442240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958227d6-49c2-4f68-9b88-7a9e4e0b6925 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.442572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b78c51-66e9-442a-92bb-1e8e9a19a4f1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:32.442697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958227d6-49c2-4f68-9b88-7a9e4e0b6925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.459197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b78c51-66e9-442a-92bb-1e8e9a19a4f1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:32.467373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618246bb-8467-4871-adf1-1592828bf120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:32.468534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618246bb-8467-4871-adf1-1592828bf120 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.469139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618246bb-8467-4871-adf1-1592828bf120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.469719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618246bb-8467-4871-adf1-1592828bf120 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.471122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618246bb-8467-4871-adf1-1592828bf120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:32.471686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618246bb-8467-4871-adf1-1592828bf120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:32.473601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618246bb-8467-4871-adf1-1592828bf120 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:32.489065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 789/1543] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:32.490971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a7ed3-e9a1-4ec3-974f-8aa8ff7a81d3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.491565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a7ed3-e9a1-4ec3-974f-8aa8ff7a81d3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.492061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a7ed3-e9a1-4ec3-974f-8aa8ff7a81d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.498986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-958227d6-49c2-4f68-9b88-7a9e4e0b6925 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:32.500552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-958227d6-49c2-4f68-9b88-7a9e4e0b6925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:32.514310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-277a7ed3-e9a1-4ec3-974f-8aa8ff7a81d3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:32.515949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-277a7ed3-e9a1-4ec3-974f-8aa8ff7a81d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:32.524446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 755/1544] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:32.532071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958227d6-49c2-4f68-9b88-7a9e4e0b6925 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:32.538595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 790/1545] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:32.540161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a7ed3-e9a1-4ec3-974f-8aa8ff7a81d3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:32.556888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958227d6-49c2-4f68-9b88-7a9e4e0b6925 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:32.556888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:32.557423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.557708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.558548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.559251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:32.559375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a7ed3-e9a1-4ec3-974f-8aa8ff7a81d3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:32.563500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:32.582443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e95a2a-eb46-4810-8e16-2606e8bd0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:32.583625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e95a2a-eb46-4810-8e16-2606e8bd0c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.584154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e95a2a-eb46-4810-8e16-2606e8bd0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.584675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e95a2a-eb46-4810-8e16-2606e8bd0c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.586458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e95a2a-eb46-4810-8e16-2606e8bd0c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:32.591855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e95a2a-eb46-4810-8e16-2606e8bd0c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:32.593982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e95a2a-eb46-4810-8e16-2606e8bd0c95 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:32.623897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 791/1546] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:32.627513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041304-0d2f-4660-82f5-bd6fb1e6427e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.634635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041304-0d2f-4660-82f5-bd6fb1e6427e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.635453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041304-0d2f-4660-82f5-bd6fb1e6427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.677257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a4041304-0d2f-4660-82f5-bd6fb1e6427e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:32.678861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a4041304-0d2f-4660-82f5-bd6fb1e6427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:32.692426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 792/1547] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:32.693739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041304-0d2f-4660-82f5-bd6fb1e6427e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:32.711503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041304-0d2f-4660-82f5-bd6fb1e6427e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:32.725297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be447-5830-4fc0-aad7-eb3f14775eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:32.726447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be447-5830-4fc0-aad7-eb3f14775eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.726956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be447-5830-4fc0-aad7-eb3f14775eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.727453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be447-5830-4fc0-aad7-eb3f14775eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.732249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be447-5830-4fc0-aad7-eb3f14775eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:32.733632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-d88be447-5830-4fc0-aad7-eb3f14775eb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:30:32.733632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:30:32.733632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:30:32.735232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be447-5830-4fc0-aad7-eb3f14775eb0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:32.804227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 756/1548] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/projects => generated 365 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:32.806226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:32.862796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 793/1549] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:32.867298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b60379-ad52-4605-a270-7141c2cf712b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.867564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b60379-ad52-4605-a270-7141c2cf712b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.867832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b60379-ad52-4605-a270-7141c2cf712b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.886585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022daf-93e8-43f3-abf4-46dba1350fcd admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:32.909578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e0b60379-ad52-4605-a270-7141c2cf712b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:32.912550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e0b60379-ad52-4605-a270-7141c2cf712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:32.956895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:32.957980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.958433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.959940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:32.960888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:32.961364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:32.962550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING py.warnings [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:30:32.962550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: warnings.warn(msg) May 05 15:30:32.962550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: May 05 15:30:32.963864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407d1c8-74e8-415c-9961-fb4fc2eeb5b9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:32.978541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 757/1550] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:32.980283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbebbac-3a8b-4a03-830c-d17ae8c76be7 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:32.980809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbebbac-3a8b-4a03-830c-d17ae8c76be7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:32.981241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbebbac-3a8b-4a03-830c-d17ae8c76be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.002378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bfbebbac-3a8b-4a03-830c-d17ae8c76be7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.004075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bfbebbac-3a8b-4a03-830c-d17ae8c76be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.015289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 758/1551] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.017346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbebbac-3a8b-4a03-830c-d17ae8c76be7 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.028066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbebbac-3a8b-4a03-830c-d17ae8c76be7 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.033223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.034204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.034642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.035010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.036034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.037257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING py.warnings [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:30:33.037257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: warnings.warn(msg) May 05 15:30:33.037257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: May 05 15:30:33.039059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.042313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 794/1552] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.044690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b60379-ad52-4605-a270-7141c2cf712b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.054969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b60379-ad52-4605-a270-7141c2cf712b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.061417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdac05c-1f5b-4975-b532-b6eb96fcb5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.061903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac05c-1f5b-4975-b532-b6eb96fcb5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.062185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac05c-1f5b-4975-b532-b6eb96fcb5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.062462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac05c-1f5b-4975-b532-b6eb96fcb5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.063189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdac05c-1f5b-4975-b532-b6eb96fcb5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.065190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdac05c-1f5b-4975-b532-b6eb96fcb5e1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.156113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 759/1553] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:33.157004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.166423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de504-6ff0-4f7d-85ba-d6283f366d53 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.172218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b4e4b-7a26-414c-9bce-17f26d0596c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.172887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4e4b-7a26-414c-9bce-17f26d0596c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.173169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4e4b-7a26-414c-9bce-17f26d0596c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.173472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4e4b-7a26-414c-9bce-17f26d0596c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.174192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b4e4b-7a26-414c-9bce-17f26d0596c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.176245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b4e4b-7a26-414c-9bce-17f26d0596c0 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.187104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 795/1554] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:33.187104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64039c7-fd04-4d40-855b-d2b8b7939bcb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.187104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64039c7-fd04-4d40-855b-d2b8b7939bcb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.187104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64039c7-fd04-4d40-855b-d2b8b7939bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.199166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a64039c7-fd04-4d40-855b-d2b8b7939bcb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.200392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a64039c7-fd04-4d40-855b-d2b8b7939bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.208270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 796/1555] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.214028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c5c6-a97d-403d-98e7-d889acbd3de4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.214028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c5c6-a97d-403d-98e7-d889acbd3de4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.214028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c5c6-a97d-403d-98e7-d889acbd3de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.229149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-58b2c5c6-a97d-403d-98e7-d889acbd3de4 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.231062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-58b2c5c6-a97d-403d-98e7-d889acbd3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.239422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 797/1556] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.240889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34740c-75a5-4083-9792-22b74d96304d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.241178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34740c-75a5-4083-9792-22b74d96304d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.241454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34740c-75a5-4083-9792-22b74d96304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.259749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5c34740c-75a5-4083-9792-22b74d96304d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.260929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5c34740c-75a5-4083-9792-22b74d96304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.269745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 798/1557] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.271123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2533-bdae-41a5-b5c8-fff9447af7b9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.271414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2533-bdae-41a5-b5c8-fff9447af7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.271722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2533-bdae-41a5-b5c8-fff9447af7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.279644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 760/1558] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:33.280995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f9fe-397a-4778-9eea-451ed4eb2dae None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.281282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f9fe-397a-4778-9eea-451ed4eb2dae None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.281556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f9fe-397a-4778-9eea-451ed4eb2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.294993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-461c2533-bdae-41a5-b5c8-fff9447af7b9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.296238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-461c2533-bdae-41a5-b5c8-fff9447af7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.299915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-37b8f9fe-397a-4778-9eea-451ed4eb2dae None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.301115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-37b8f9fe-397a-4778-9eea-451ed4eb2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.357495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 799/1559] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.358476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2533-bdae-41a5-b5c8-fff9447af7b9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.361962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 761/1560] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.361962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8f9fe-397a-4778-9eea-451ed4eb2dae None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.373331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8f9fe-397a-4778-9eea-451ed4eb2dae None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.373445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2533-bdae-41a5-b5c8-fff9447af7b9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.376926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.377593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.377706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f0eb5-0293-47cb-950c-e3cd4c7e897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.377880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.378155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.378519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0eb5-0293-47cb-950c-e3cd4c7e897c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.378810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0eb5-0293-47cb-950c-e3cd4c7e897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.378930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.379115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0eb5-0293-47cb-950c-e3cd4c7e897c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.379913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0eb5-0293-47cb-950c-e3cd4c7e897c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.380556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.381751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0eb5-0293-47cb-950c-e3cd4c7e897c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.396038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 800/1561] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:33.396038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97b8a5-c522-49d6-9f1c-f187c2b9016e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.396038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97b8a5-c522-49d6-9f1c-f187c2b9016e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.396038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97b8a5-c522-49d6-9f1c-f187c2b9016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.396667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 762/1562] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:33.398869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.409133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e30117-206a-469e-ad9c-22eba0bd2687 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.413980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.414660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.414946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.415223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.415505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1f97b8a5-c522-49d6-9f1c-f187c2b9016e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.415994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:33.416301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.416723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1f97b8a5-c522-49d6-9f1c-f187c2b9016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.418430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.425415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 801/1563] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.428812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be567349-b230-4403-9600-b50453dccc68 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.429073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be567349-b230-4403-9600-b50453dccc68 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.429357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be567349-b230-4403-9600-b50453dccc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.437927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 763/1564] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:33.437927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.443829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccec8-b14d-44db-b12f-cb965cbf165f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.448424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-be567349-b230-4403-9600-b50453dccc68 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.449372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.449637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-be567349-b230-4403-9600-b50453dccc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.450044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.450332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.450750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.451447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.453428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.458001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 802/1565] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.458627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be567349-b230-4403-9600-b50453dccc68 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.469575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be567349-b230-4403-9600-b50453dccc68 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.474405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ff6d-f34b-4f6d-9fa3-27ff1f228619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.477886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ff6d-f34b-4f6d-9fa3-27ff1f228619 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.477886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ff6d-f34b-4f6d-9fa3-27ff1f228619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.477886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ff6d-f34b-4f6d-9fa3-27ff1f228619 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.477886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ff6d-f34b-4f6d-9fa3-27ff1f228619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:33.477886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ff6d-f34b-4f6d-9fa3-27ff1f228619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.478346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ff6d-f34b-4f6d-9fa3-27ff1f228619 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.490054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 803/1566] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:33.491424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a808b-3b22-4e59-8254-d1b0c095c294 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.491737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a808b-3b22-4e59-8254-d1b0c095c294 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.492024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a808b-3b22-4e59-8254-d1b0c095c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.510162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6f0a808b-3b22-4e59-8254-d1b0c095c294 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.512206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6f0a808b-3b22-4e59-8254-d1b0c095c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.519739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 804/1567] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:33.520513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a808b-3b22-4e59-8254-d1b0c095c294 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.529588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a808b-3b22-4e59-8254-d1b0c095c294 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.534347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.534986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.535267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.535595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.536299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.537877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.548247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 805/1568] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:33.549042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.559341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3c3a-a8e8-422f-880a-5e6b48a20bb4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.564128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.564785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.565068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.565341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.566096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.567682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.577874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 806/1569] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:33.578798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.581222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 764/1570] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:33.581222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.590704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f5efd-62f2-4d75-8652-4dbad16c6a19 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.590829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c89a6-d0eb-477a-9a48-5b0a7d59d8de admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.595706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.595947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.596360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.596597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.596706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.596883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.596987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.597164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.597611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:33.597854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.597984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.599508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.599802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.613113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 807/1571] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:33.613970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.629859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a432cc-fa1e-4d13-a7d4-058be8dd6b29 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.635972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.636644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.636932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.637209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.637939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:33.638245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.639882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.652452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 808/1572] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:33.658223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.663406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c115ec4-ddde-46af-96ca-937d80339e13 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.668826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.669586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.669890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.670182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.670875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.672826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.689201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 765/1573] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:33.690217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.755979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66595e53-2d3d-4468-81e2-1fa12ae459ea admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.760817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.761501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.761769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.762044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.762783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:33.763089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.764782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.772814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 809/1574] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:33.773827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.780865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 766/1575] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:33.791928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.798906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e034-fd2a-4af8-877c-eaa8f39266ab admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.840049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d13b83-49b1-485f-b6e5-7024a6b28a30 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.845586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.848619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.848619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.848619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] PATH_INFO: `/v3/projects/1b5242bdff614324ba88f8dddc64c136/users/806bb02a3f9e45e6895b0f67f1fee7bd/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.866877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.867880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.868169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.868461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] PATH_INFO: `/v3/projects/d5749714520245aaaf1d3bbfbff50f83/users/7f92a7aeb4664a8db7f67e03cf90c1ef/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.875598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5242bdff614324ba88f8dddc64c136, user_id=806bb02a3f9e45e6895b0f67f1fee7bd, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.877625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:30:33.877625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:30:33.877625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:30:33.879039 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.883990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5749714520245aaaf1d3bbfbff50f83, user_id=7f92a7aeb4664a8db7f67e03cf90c1ef, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.887353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.957840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 810/1576] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:33 2022] PUT /identity/v3/projects/1b5242bdff614324ba88f8dddc64c136/users/806bb02a3f9e45e6895b0f67f1fee7bd/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:33.958631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.987580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 767/1577] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:33 2022] PUT /identity/v3/projects/d5749714520245aaaf1d3bbfbff50f83/users/7f92a7aeb4664a8db7f67e03cf90c1ef/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:33.988410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.031344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8ee9f-800c-415a-a5ce-316f1d2b043e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.054783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683835-b5d9-408e-805d-66e6ab74acaf admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.059882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.060571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.060854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.061129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.061821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.063741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.088281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.089075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.089435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.089771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.090500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.092167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.102260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 811/1578] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:34.103204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.113485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd08d1-b869-4356-ab11-19e05031f703 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.118189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.118835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.119122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.119398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.120136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.122569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.145701 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 768/1579] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.146681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.206416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 812/1580] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.207333 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.210674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c45d5-0aca-438d-92e3-1ec5d79f89ae admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.275097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.275812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.276103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.276384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.277077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.279000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.279733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1786b-566a-405c-81cc-6e1a2cc1a711 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.284437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28dcb4-a5fc-4477-b199-4c72fc78282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.285098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28dcb4-a5fc-4477-b199-4c72fc78282e admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.285380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28dcb4-a5fc-4477-b199-4c72fc78282e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.285654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28dcb4-a5fc-4477-b199-4c72fc78282e admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.286507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28dcb4-a5fc-4477-b199-4c72fc78282e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.288449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28dcb4-a5fc-4477-b199-4c72fc78282e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.385432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 769/1581] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.386460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.396769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ee6e-ad0a-4a8d-9f2d-0609d8672afa admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.402479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.406498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.406498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.406498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.406498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.407002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.413481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 813/1582] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.414993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb189b4-4e1c-4028-ba1b-fb948af5b9e7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.415192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb189b4-4e1c-4028-ba1b-fb948af5b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.415498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb189b4-4e1c-4028-ba1b-fb948af5b9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.441903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5eb189b4-4e1c-4028-ba1b-fb948af5b9e7 None None] MFA Rules not processed for user `806bb02a3f9e45e6895b0f67f1fee7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:34.443114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5eb189b4-4e1c-4028-ba1b-fb948af5b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:34.508034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 814/1583] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:34.509271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9914-95c1-4060-ad2c-1d06c9143606 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.509554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9914-95c1-4060-ad2c-1d06c9143606 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.509832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9914-95c1-4060-ad2c-1d06c9143606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.516544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 770/1584] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.518373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.529754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e00a9914-95c1-4060-ad2c-1d06c9143606 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:34.534798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e00a9914-95c1-4060-ad2c-1d06c9143606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:34.589775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a316-71c6-4804-89e8-e81a1f2ac91d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.594661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.595613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.595898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.596170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.596888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.597989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 815/1585] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:34.598483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.598808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9914-95c1-4060-ad2c-1d06c9143606 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.608671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9914-95c1-4060-ad2c-1d06c9143606 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.611206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 771/1586] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:34.611993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.613581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.614328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.614619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.614886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.615610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.617541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.621587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2c34f-6bb6-40e3-a7fa-ac47744ff7ef admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.630044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.630717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.631074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.631364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.632079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.634018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.749181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 816/1587] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.749181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.758138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211b885-8cf1-42fe-83b6-aba2b8b5aa8a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.763513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.764249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.764532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.764807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.765933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.767124 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.767902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 772/1588] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.768821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.779168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 817/1589] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:34.780109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.783927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee04ed-7189-4836-8701-de17b06939a0 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.788774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.789448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.789733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.790014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.790198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065e5d2-2bc1-4438-9c18-89dacf964256 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.790746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.792424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.794834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.795525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.795818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.796110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.796798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.798717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.804113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 773/1590] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:34.804949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.860060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db938-3817-4e5d-bfab-ad8527f6c0d5 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.863611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.864257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.864418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 818/1591] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:34 2022] POST /identity/v3/users => generated 282 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:34.864530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.864806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.865267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.921422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637771c-ab93-45e5-a2aa-10191b752123 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.923364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.924869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.925077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.925728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.926016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.926304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.933773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 774/1592] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:34.934564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.935785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.937224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.945055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730be5-29c6-4e2b-a46f-70d4d350d187 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.947279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 819/1593] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:34.947960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.955979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.956888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.957174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.957552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] PATH_INFO: `/v3/projects/c568bdf23881488d8b4d60af4666f526/users/127ba6f3352144df886bb9a45986f58d/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.957806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7aad-f24c-4ce2-bf49-752d8794ad46 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.963499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.964745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.965035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.965317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.966052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.967691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.979556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 820/1594] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:34.979804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c568bdf23881488d8b4d60af4666f526, user_id=127ba6f3352144df886bb9a45986f58d, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.979936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.981961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.989920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3287ee-c1bf-4852-a419-2032ea1840bc admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.994665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.995359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.995674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.995956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.996681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.998309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.013048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 821/1595] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:35.013048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.022849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5e90-79ae-48a4-87b6-5972ae87d378 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.028404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.029109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.029501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.029654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.030386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.032211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.043452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 822/1596] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:35.044404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.054461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209433-c16a-4072-8066-0d519f18f272 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.066956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 775/1597] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:34 2022] PUT /identity/v3/projects/c568bdf23881488d8b4d60af4666f526/users/127ba6f3352144df886bb9a45986f58d/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:35.077551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.077551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.077551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.077551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.077913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.077913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.078058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.093677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 823/1598] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:35.094726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.110804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ffcd0-b79f-4c91-a25b-d29b33a0d6c9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.166985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95027b-3218-4a21-9bbc-3be9cfd026d9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.172353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.173046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.173331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.173608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.174397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.176092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.185879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.186644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.186986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.187273 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.188166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.189001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 776/1599] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:35.191688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.191812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.205288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 824/1600] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:35.206337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.215509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a143f8-b95d-4a17-b633-4701ea6a74b7 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.221937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc841f-051f-42d9-965b-069dfc05b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.222768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc841f-051f-42d9-965b-069dfc05b4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.223389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc841f-051f-42d9-965b-069dfc05b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.223924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc841f-051f-42d9-965b-069dfc05b4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.224328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b38df-bc71-43aa-8909-6cb9ef00bcc3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.224926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc841f-051f-42d9-965b-069dfc05b4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.226710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc841f-051f-42d9-965b-069dfc05b4d9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.229301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.230319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.230557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.230846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] PATH_INFO: `/v3/projects/109b09aacb3340699dd54612fc172f09/users/f48f33c38ef54734a77e2fc4eab6c61c/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.239283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 777/1601] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:35.240776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018dd4-b28c-424c-9afe-96a096ae2bd2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.241169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018dd4-b28c-424c-9afe-96a096ae2bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.241488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018dd4-b28c-424c-9afe-96a096ae2bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.265282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=109b09aacb3340699dd54612fc172f09, user_id=f48f33c38ef54734a77e2fc4eab6c61c, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.271616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.276355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f6018dd4-b28c-424c-9afe-96a096ae2bd2 None None] MFA Rules not processed for user `127ba6f3352144df886bb9a45986f58d`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:35.277641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f6018dd4-b28c-424c-9afe-96a096ae2bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:35.351102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 825/1602] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:35 2022] PUT /identity/v3/projects/109b09aacb3340699dd54612fc172f09/users/f48f33c38ef54734a77e2fc4eab6c61c/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:35.351811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.366705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 778/1603] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:35.367748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6018dd4-b28c-424c-9afe-96a096ae2bd2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.382031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6018dd4-b28c-424c-9afe-96a096ae2bd2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.420299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59657-e173-4bad-a549-e45ccd9249ef admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.426215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.427742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.428104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.428392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] PATH_INFO: `/v3/projects/432804d7e09449b69b0ce11c92fe4240/users/68239e70245a4922b8c7961dd8962baa/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.445025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=432804d7e09449b69b0ce11c92fe4240, user_id=68239e70245a4922b8c7961dd8962baa, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.447629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.456779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.457729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.457978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.458388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.459266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.461950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.475522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 779/1604] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:35.475522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.487121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eb372-3ab0-4516-96dd-12fe6c1b3564 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.492393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc016d4-f817-4d00-b7bc-dbdb257d8c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.493342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc016d4-f817-4d00-b7bc-dbdb257d8c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.493626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc016d4-f817-4d00-b7bc-dbdb257d8c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.493910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc016d4-f817-4d00-b7bc-dbdb257d8c0f admin admin] PATH_INFO: `/v3/projects/cf5faa51bd0c4b3584365948ad227668/users/2ca44c6702304a53a176bebdb6ccbe3f/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.509748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc016d4-f817-4d00-b7bc-dbdb257d8c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5faa51bd0c4b3584365948ad227668, user_id=2ca44c6702304a53a176bebdb6ccbe3f, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.513164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc016d4-f817-4d00-b7bc-dbdb257d8c0f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.557552 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 826/1605] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:35 2022] PUT /identity/v3/projects/432804d7e09449b69b0ce11c92fe4240/users/68239e70245a4922b8c7961dd8962baa/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:35.558569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.596451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 780/1606] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:35 2022] PUT /identity/v3/projects/cf5faa51bd0c4b3584365948ad227668/users/2ca44c6702304a53a176bebdb6ccbe3f/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:35.600739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b25c6-2e53-4623-a439-00b118609c8b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.600739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b25c6-2e53-4623-a439-00b118609c8b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.600739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b25c6-2e53-4623-a439-00b118609c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.625349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c15b25c6-2e53-4623-a439-00b118609c8b None None] MFA Rules not processed for user `f48f33c38ef54734a77e2fc4eab6c61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:35.626627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c15b25c6-2e53-4623-a439-00b118609c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:35.636500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9741e-1dd2-4cea-8f7e-89d1f6f79c8d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.703044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 781/1607] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:35.706139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e05b-b23e-4f81-9cad-f6050063346b None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.706432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e05b-b23e-4f81-9cad-f6050063346b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.706706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e05b-b23e-4f81-9cad-f6050063346b None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.711518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 782/1608] 10.222.0.55 () {54 vars in 960 bytes} [Thu May 5 15:30:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:35.711518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e05b-b23e-4f81-9cad-f6050063346b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:35.716167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ae43a-b04b-46ea-a2d4-6dc23a6b4ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.717334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ae43a-b04b-46ea-a2d4-6dc23a6b4ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.717762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ae43a-b04b-46ea-a2d4-6dc23a6b4ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.718199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ae43a-b04b-46ea-a2d4-6dc23a6b4ddd admin admin] PATH_INFO: `/v3/projects/72f4e78cd69041eaa1f81b3ea4ed27d4/users/65b7373b2c664dc4a054b8943d1d231c/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.734266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e05b-b23e-4f81-9cad-f6050063346b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:35.736833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ae43a-b04b-46ea-a2d4-6dc23a6b4ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f4e78cd69041eaa1f81b3ea4ed27d4, user_id=65b7373b2c664dc4a054b8943d1d231c, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.739924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ae43a-b04b-46ea-a2d4-6dc23a6b4ddd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.740520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5b6a-1221-468e-8715-1cec8e2aaa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:35.741520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b6a-1221-468e-8715-1cec8e2aaa77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.741907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b6a-1221-468e-8715-1cec8e2aaa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.742285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b6a-1221-468e-8715-1cec8e2aaa77 admin admin] PATH_INFO: `/v3/projects/54befb77e0c042eb9a45ea82c966d217/users/f079dca4beed4f6b9233706be0b6809e/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.762306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5b6a-1221-468e-8715-1cec8e2aaa77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54befb77e0c042eb9a45ea82c966d217, user_id=f079dca4beed4f6b9233706be0b6809e, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:35.765078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5b6a-1221-468e-8715-1cec8e2aaa77 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:35.859205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 827/1609] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:35 2022] PUT /identity/v3/projects/72f4e78cd69041eaa1f81b3ea4ed27d4/users/65b7373b2c664dc4a054b8943d1d231c/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:35.860857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f42a-8f41-4fc9-8207-6bf08ccd9b04 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.861147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f42a-8f41-4fc9-8207-6bf08ccd9b04 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.861422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f42a-8f41-4fc9-8207-6bf08ccd9b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.879563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ada2f42a-8f41-4fc9-8207-6bf08ccd9b04 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:35.880789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ada2f42a-8f41-4fc9-8207-6bf08ccd9b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:35.904948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 783/1610] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:35 2022] PUT /identity/v3/projects/54befb77e0c042eb9a45ea82c966d217/users/f079dca4beed4f6b9233706be0b6809e/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:35.904948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386de7-755b-4dba-acc4-4a62a6ba406a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.905364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386de7-755b-4dba-acc4-4a62a6ba406a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.905696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386de7-755b-4dba-acc4-4a62a6ba406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.925138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-76386de7-755b-4dba-acc4-4a62a6ba406a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:35.926439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-76386de7-755b-4dba-acc4-4a62a6ba406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:35.947960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 828/1611] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:35.950137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24305da9-5a9e-4930-9555-da721781617c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:35.950458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24305da9-5a9e-4930-9555-da721781617c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:35.950734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24305da9-5a9e-4930-9555-da721781617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:35.971614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-24305da9-5a9e-4930-9555-da721781617c None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:35.972855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-24305da9-5a9e-4930-9555-da721781617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.000193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 784/1612] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:36.001808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3a552-5788-41a9-aff1-313e886bab02 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.008342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3a552-5788-41a9-aff1-313e886bab02 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.008342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3a552-5788-41a9-aff1-313e886bab02 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.008342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 785/1613] 10.222.0.55 () {54 vars in 960 bytes} [Thu May 5 15:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:36.008342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167394f-699a-4f9d-a69b-fcaf5194fdc3 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.008342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167394f-699a-4f9d-a69b-fcaf5194fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.008342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167394f-699a-4f9d-a69b-fcaf5194fdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.039127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a167394f-699a-4f9d-a69b-fcaf5194fdc3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:36.042781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a167394f-699a-4f9d-a69b-fcaf5194fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.077718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 786/1614] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:36.080329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8bea2-75ea-419e-9f10-a2b08e69165d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.080329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8bea2-75ea-419e-9f10-a2b08e69165d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.080329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8bea2-75ea-419e-9f10-a2b08e69165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.083318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 829/1615] 10.222.0.55 () {58 vars in 1057 bytes} [Thu May 5 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:36.084224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24305da9-5a9e-4930-9555-da721781617c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.085703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-24305da9-5a9e-4930-9555-da721781617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.117526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9af8bea2-75ea-419e-9f10-a2b08e69165d None None] MFA Rules not processed for user `f079dca4beed4f6b9233706be0b6809e`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:36.118699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9af8bea2-75ea-419e-9f10-a2b08e69165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.148993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24305da9-5a9e-4930-9555-da721781617c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.153487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d2e17-9a09-433e-be69-1338f8486cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.154163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2e17-9a09-433e-be69-1338f8486cbb service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.154476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2e17-9a09-433e-be69-1338f8486cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.154757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2e17-9a09-433e-be69-1338f8486cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.167915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d2e17-9a09-433e-be69-1338f8486cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:36.172087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d2e17-9a09-433e-be69-1338f8486cbb service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:36.180278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 830/1616] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:36.184972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5311b7-dda1-4910-8bce-57ebfdd79140 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.185492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5311b7-dda1-4910-8bce-57ebfdd79140 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.185848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5311b7-dda1-4910-8bce-57ebfdd79140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.207853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 787/1617] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:36.208201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fa5311b7-dda1-4910-8bce-57ebfdd79140 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:36.210168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fa5311b7-dda1-4910-8bce-57ebfdd79140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.212388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8bea2-75ea-419e-9f10-a2b08e69165d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.223114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8bea2-75ea-419e-9f10-a2b08e69165d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.226776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.227424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.238877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.238877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.239106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 831/1618] 10.222.0.55 () {58 vars in 1057 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:36.239106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5311b7-dda1-4910-8bce-57ebfdd79140 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.240026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5311b7-dda1-4910-8bce-57ebfdd79140 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.242118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:36.243758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:36.247889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.249590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.250636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.251118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.255670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 788/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:36.256596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.267670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:36.270790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e808db-2711-4a60-a9c8-2e7ddde3d49c service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.279135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:36.280394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092cf92-5e6f-466f-941e-4f260b48def6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.283747 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092cf92-5e6f-466f-941e-4f260b48def6 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.284172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092cf92-5e6f-466f-941e-4f260b48def6 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.284429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092cf92-5e6f-466f-941e-4f260b48def6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.291901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 832/1620] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:36.293744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.311890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d81d89-414c-47cf-94e5-d1b6c8497939 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.319536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.320579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.320931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.321287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.322694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:36.325375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:36.398749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092cf92-5e6f-466f-941e-4f260b48def6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:36.402780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092cf92-5e6f-466f-941e-4f260b48def6 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:36.409286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 833/1621] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:36.410471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.439718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 789/1622] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:36.443711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081870-e477-440c-9861-b2cc6e1a6b04 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.443711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081870-e477-440c-9861-b2cc6e1a6b04 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.443711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081870-e477-440c-9861-b2cc6e1a6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.488568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3f081870-e477-440c-9861-b2cc6e1a6b04 None None] MFA Rules not processed for user `7f92a7aeb4664a8db7f67e03cf90c1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:36.490315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3f081870-e477-440c-9861-b2cc6e1a6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.577137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755f13-b1a3-425e-9cae-0818bc97762d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.591663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd5d90-b417-482b-9484-1ded94094638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.592349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5d90-b417-482b-9484-1ded94094638 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.592703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5d90-b417-482b-9484-1ded94094638 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.592987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5d90-b417-482b-9484-1ded94094638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.619498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 790/1623] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:36.619498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f081870-e477-440c-9861-b2cc6e1a6b04 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.777054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f081870-e477-440c-9861-b2cc6e1a6b04 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.783903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd5d90-b417-482b-9484-1ded94094638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:36.790100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd5d90-b417-482b-9484-1ded94094638 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:36.790320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.791819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.792590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.792945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.794963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:36.798260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:36.813522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 834/1624] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:36.815997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c20fc0-bd79-4233-9814-dc9b50906dbf None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.816470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c20fc0-bd79-4233-9814-dc9b50906dbf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.817032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c20fc0-bd79-4233-9814-dc9b50906dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.849003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-52c20fc0-bd79-4233-9814-dc9b50906dbf None None] MFA Rules not processed for user `7f92a7aeb4664a8db7f67e03cf90c1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:36.851635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52c20fc0-bd79-4233-9814-dc9b50906dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.866401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 835/1625] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:36.869051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd5a22-80c6-4d67-8058-d9158312ea43 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.870946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd5a22-80c6-4d67-8058-d9158312ea43 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.870946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd5a22-80c6-4d67-8058-d9158312ea43 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.875544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 836/1626] 10.222.0.55 () {54 vars in 912 bytes} [Thu May 5 15:30:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:36.884227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d85b0-7d8a-49b2-abc9-16fb9e305a45 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.885923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d85b0-7d8a-49b2-abc9-16fb9e305a45 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.886646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d85b0-7d8a-49b2-abc9-16fb9e305a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.943602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d51d85b0-7d8a-49b2-abc9-16fb9e305a45 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:36.946379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d51d85b0-7d8a-49b2-abc9-16fb9e305a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.951917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 791/1627] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/users => generated 288 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:36.953043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:36.970705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf8fa-3853-4041-a8eb-0aafd916444a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:36.990246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:36.991840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 837/1628] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:37.026380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.028325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.028623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.031948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.036597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d85b0-7d8a-49b2-abc9-16fb9e305a45 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.038903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.106004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 792/1629] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:37.110903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.163388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae1e2-1452-4ee2-8122-4a5ccef4416c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.170193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0bcd-e7d2-4aea-bc4e-f38bcef50f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.171648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0bcd-e7d2-4aea-bc4e-f38bcef50f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.172181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0bcd-e7d2-4aea-bc4e-f38bcef50f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.172677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0bcd-e7d2-4aea-bc4e-f38bcef50f2a admin admin] PATH_INFO: `/v3/projects/6c1d7cc9bbdf4457ba79a9522a774d64/users/524e7249df1547c8ac6747f29840880c/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.229460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0bcd-e7d2-4aea-bc4e-f38bcef50f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1d7cc9bbdf4457ba79a9522a774d64, user_id=524e7249df1547c8ac6747f29840880c, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.233886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0bcd-e7d2-4aea-bc4e-f38bcef50f2a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.241903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d85b0-7d8a-49b2-abc9-16fb9e305a45 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.255974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.258742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.259655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.260537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.297182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.301539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.334093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 838/1630] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:37.391155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 793/1631] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:37 2022] PUT /identity/v3/projects/6c1d7cc9bbdf4457ba79a9522a774d64/users/524e7249df1547c8ac6747f29840880c/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:37.405399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.413976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e231c-d4a9-4402-99a1-da495d1178b2 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.416556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e231c-d4a9-4402-99a1-da495d1178b2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.416556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e231c-d4a9-4402-99a1-da495d1178b2 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.416556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 794/1632] 10.222.0.55 () {54 vars in 912 bytes} [Thu May 5 15:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:30:37.430731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c1c2-e736-4072-8a9e-2e5f8e762dd2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.430731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c1c2-e736-4072-8a9e-2e5f8e762dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.431083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c1c2-e736-4072-8a9e-2e5f8e762dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.461049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40071bc-2a78-4887-b5b3-a4c2dcabeadb service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.487627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7ec3c1c2-e736-4072-8a9e-2e5f8e762dd2 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:37.493853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7ec3c1c2-e736-4072-8a9e-2e5f8e762dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:37.608378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.609125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.609374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.609887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.610466 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.612672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.631253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 839/1633] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:37.639034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.673950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358f646-dce5-42b2-ab3b-56e957ffdb6b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.692402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebea8-0be6-44cb-8e0c-c8fa4f162cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.707434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 795/1634] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:30:37.721913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebea8-0be6-44cb-8e0c-c8fa4f162cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.721913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebea8-0be6-44cb-8e0c-c8fa4f162cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.721913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebea8-0be6-44cb-8e0c-c8fa4f162cd9 admin admin] PATH_INFO: `/v3/projects/6c1d7cc9bbdf4457ba79a9522a774d64/users/524e7249df1547c8ac6747f29840880c/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.726126 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c1c2-e736-4072-8a9e-2e5f8e762dd2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.730568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bebea8-0be6-44cb-8e0c-c8fa4f162cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1d7cc9bbdf4457ba79a9522a774d64, user_id=524e7249df1547c8ac6747f29840880c, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.753020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bebea8-0be6-44cb-8e0c-c8fa4f162cd9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.774333 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 840/1635] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:37 2022] PUT /identity/v3/projects/6c1d7cc9bbdf4457ba79a9522a774d64/users/524e7249df1547c8ac6747f29840880c/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:37.787566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d7c3-885c-4bc8-ac42-b9584e606d21 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.787932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d7c3-885c-4bc8-ac42-b9584e606d21 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.788125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d7c3-885c-4bc8-ac42-b9584e606d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.826268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-31b4d7c3-885c-4bc8-ac42-b9584e606d21 None None] MFA Rules not processed for user `524e7249df1547c8ac6747f29840880c`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:37.827977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-31b4d7c3-885c-4bc8-ac42-b9584e606d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:37.906197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c1c2-e736-4072-8a9e-2e5f8e762dd2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.935690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 841/1636] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:30:37.978403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.978974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.979356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.979549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:38.097589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:38.100400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:38.122442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 796/1637] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:38.275635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4d7c3-885c-4bc8-ac42-b9584e606d21 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:38.311134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4d7c3-885c-4bc8-ac42-b9584e606d21 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:38.319667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:38.320479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:38.322563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:38.322563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:38.344203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:38.350285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:38.381807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 842/1638] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:38.626722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:38.655371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a93f-4c84-493b-a505-622488c70f28 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:38.690987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db928882-1939-46a7-add5-75d73d24feb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:38.690987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db928882-1939-46a7-add5-75d73d24feb0 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:38.690987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db928882-1939-46a7-add5-75d73d24feb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:38.691453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db928882-1939-46a7-add5-75d73d24feb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:38.860945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:38.871656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871b1fd-1683-4baa-a58e-35b6406970ec service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:38.876288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a1917-f7eb-4ee0-a958-e676f940452b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:38.877197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a1917-f7eb-4ee0-a958-e676f940452b service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:38.877646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a1917-f7eb-4ee0-a958-e676f940452b service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:38.878217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a1917-f7eb-4ee0-a958-e676f940452b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:38.888753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db928882-1939-46a7-add5-75d73d24feb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:38.915078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db928882-1939-46a7-add5-75d73d24feb0 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:38.984287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 797/1639] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:39.048995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a1917-f7eb-4ee0-a958-e676f940452b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:39.056596 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a1917-f7eb-4ee0-a958-e676f940452b service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:39.106068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 843/1640] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:39.872372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5516-63e7-4263-a5f8-74d39ca44990 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:39.873338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5516-63e7-4263-a5f8-74d39ca44990 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:39.874915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5516-63e7-4263-a5f8-74d39ca44990 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:39.876843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 798/1641] 10.222.0.55 () {54 vars in 912 bytes} [Thu May 5 15:30:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:39.883908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c145c8-f328-44ef-a990-ad90089dca90 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:39.884444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c145c8-f328-44ef-a990-ad90089dca90 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:39.884542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c145c8-f328-44ef-a990-ad90089dca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:40.001302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b0c145c8-f328-44ef-a990-ad90089dca90 None None] MFA Rules not processed for user `9c25e83af7604455bad1d7c0ee1c0122`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:40.003819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b0c145c8-f328-44ef-a990-ad90089dca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:40.117900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 844/1642] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:30:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:40.141638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e5516-63e7-4263-a5f8-74d39ca44990 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:40.179993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e5516-63e7-4263-a5f8-74d39ca44990 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:40.194332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4b253-51ee-4ef0-bd87-446aa6e045f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:40.195007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b253-51ee-4ef0-bd87-446aa6e045f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:40.197493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b253-51ee-4ef0-bd87-446aa6e045f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:40.197493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b253-51ee-4ef0-bd87-446aa6e045f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:40.213564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4b253-51ee-4ef0-bd87-446aa6e045f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:40.215460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4b253-51ee-4ef0-bd87-446aa6e045f3 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:40.227332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 799/1643] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:41.815421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050577b7-03ef-4448-b192-fe629a3b4e79 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:41.816237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050577b7-03ef-4448-b192-fe629a3b4e79 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:41.816237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050577b7-03ef-4448-b192-fe629a3b4e79 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:41.818156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 845/1644] 10.222.0.55 () {54 vars in 960 bytes} [Thu May 5 15:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:41.830672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c67e-2633-4a8c-9cc1-3067b2ad230c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:41.831182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c67e-2633-4a8c-9cc1-3067b2ad230c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:41.831586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c67e-2633-4a8c-9cc1-3067b2ad230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:41.898864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1162c67e-2633-4a8c-9cc1-3067b2ad230c None None] MFA Rules not processed for user `4b8520e6db2346c59a1230380c515703`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:41.902120 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1162c67e-2633-4a8c-9cc1-3067b2ad230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:42.118663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 800/1645] 10.222.0.55 () {58 vars in 1057 bytes} [Thu May 5 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:30:42.134183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050577b7-03ef-4448-b192-fe629a3b4e79 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:42.150276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050577b7-03ef-4448-b192-fe629a3b4e79 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:42.178303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:42.181088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:42.185998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:42.186651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:42.190441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:42.236252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:42.240579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:42.275955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 846/1646] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:45.426647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c67e-2633-4a8c-9cc1-3067b2ad230c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:45.568440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:45.630914 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c67e-2633-4a8c-9cc1-3067b2ad230c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:45.643985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:45.644892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:45.645179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:45.645512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] PATH_INFO: `/v3/users/f079dca4beed4f6b9233706be0b6809e` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:45.650189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f079dca4beed4f6b9233706be0b6809e)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:45.656194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:45.786135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaf0bd-d233-4718-a173-141fa0097075 service placement] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:45.786135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:45.786135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:45.791344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:45.791344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] PATH_INFO: `/v3/users/f48f33c38ef54734a77e2fc4eab6c61c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:45.791344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48f33c38ef54734a77e2fc4eab6c61c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:45.793726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: WARNING py.warnings [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:30:45.793726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: warnings.warn(msg) May 05 15:30:45.793726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: May 05 15:30:45.795733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:45.938153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f079dca4beed4f6b9233706be0b6809e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:45.961135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f079dca4beed4f6b9233706be0b6809e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.065500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f079dca4beed4f6b9233706be0b6809e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.093037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f079dca4beed4f6b9233706be0b6809e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.098360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b0a69174-6f8f-422c-bc73-f60e95e1cfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f079dca4beed4f6b9233706be0b6809e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.104521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48f33c38ef54734a77e2fc4eab6c61c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.105248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48f33c38ef54734a77e2fc4eab6c61c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.117892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 801/1647] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:30:45 2022] DELETE /identity/v3/users/f079dca4beed4f6b9233706be0b6809e => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:46.131287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046911-2a8c-4985-92da-6d2f84e78766 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.133483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046911-2a8c-4985-92da-6d2f84e78766 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.136433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046911-2a8c-4985-92da-6d2f84e78766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.217476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ff046911-2a8c-4985-92da-6d2f84e78766 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:46.218704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ff046911-2a8c-4985-92da-6d2f84e78766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:46.226995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48f33c38ef54734a77e2fc4eab6c61c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.261978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48f33c38ef54734a77e2fc4eab6c61c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.263002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48f33c38ef54734a77e2fc4eab6c61c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:46.306639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 802/1648] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:46.385925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 847/1649] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:30:45 2022] DELETE /identity/v3/users/f48f33c38ef54734a77e2fc4eab6c61c => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:46.387509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.387973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.388516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.427611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:46.430788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:46.482469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:46.483029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:46.629709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366215a-5c5d-4f48-aa5a-ab8587737204 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:46.640839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 803/1650] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:30:46.645252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90973c95-a3ce-4edd-9955-4e087d23dfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:46.646138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90973c95-a3ce-4edd-9955-4e087d23dfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.646568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90973c95-a3ce-4edd-9955-4e087d23dfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.649643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90973c95-a3ce-4edd-9955-4e087d23dfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.689435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90973c95-a3ce-4edd-9955-4e087d23dfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:46.693671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90973c95-a3ce-4edd-9955-4e087d23dfe7 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:46.702073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:46.704791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:46.720521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 848/1651] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:30:46.754472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3f2a-4deb-455f-aec1-6b0e5ca43f15 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:46.773728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:46.775436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.776630 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.783071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.824028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:46.832515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:46.877319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 804/1652] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:47.242649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:47.242649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:47.242649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:47.275583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:47.277701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:47.420215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 849/1653] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:30:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:30:47.882177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:47.890442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:48.024070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:48.024970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:48.080079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f1060-7065-47a5-8328-6d44b1a185ca None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:48.106050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:48.109134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:48.109500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:48.110374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] PATH_INFO: `/v3/users/127ba6f3352144df886bb9a45986f58d` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:48.119445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127ba6f3352144df886bb9a45986f58d)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:48.123101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:48.195135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e380d-bb6b-41c8-86df-93f8a516fa71 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:48.217302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd575-3190-4c90-ab1e-4b0c8d7338fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:48.218577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd575-3190-4c90-ab1e-4b0c8d7338fb service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:48.219138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd575-3190-4c90-ab1e-4b0c8d7338fb service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:48.219633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd575-3190-4c90-ab1e-4b0c8d7338fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:48.246628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd575-3190-4c90-ab1e-4b0c8d7338fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:48.251391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd575-3190-4c90-ab1e-4b0c8d7338fb service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:48.277149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 805/1654] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:30:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:30:48.413233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127ba6f3352144df886bb9a45986f58d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:48.416520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127ba6f3352144df886bb9a45986f58d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:48.515036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127ba6f3352144df886bb9a45986f58d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:48.540832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127ba6f3352144df886bb9a45986f58d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:48.543627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127ba6f3352144df886bb9a45986f58d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:48.598590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef7bc4-49a2-4835-acdd-6ca8df805f8a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:48.599379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef7bc4-49a2-4835-acdd-6ca8df805f8a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:48.599905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef7bc4-49a2-4835-acdd-6ca8df805f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:48.627497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 850/1655] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:30:48 2022] DELETE /identity/v3/users/127ba6f3352144df886bb9a45986f58d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:48.632359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:48.640545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:48.709493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-1eef7bc4-49a2-4835-acdd-6ca8df805f8a None None] MFA Rules not processed for user `2ca44c6702304a53a176bebdb6ccbe3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:48.711739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1eef7bc4-49a2-4835-acdd-6ca8df805f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:48.989632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6800d7-773c-460f-8612-bb59b840f415 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:49.019121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:49.022111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.027030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.028073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] PATH_INFO: `/v3/projects/109b09aacb3340699dd54612fc172f09` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.031410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] RBAC: Authorizing `identity:delete_project(project_id=109b09aacb3340699dd54612fc172f09)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:49.033977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:49.046783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 806/1656] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:30:49.050597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.051990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.053679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.143096 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:49.149052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:49.239604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 807/1657] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:49.248843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:49.253975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:49.296236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109b09aacb3340699dd54612fc172f09', 'request_id': 'req-85d2590a-3b51-4781-9807-7d0386f7efad'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:49.336249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109b09aacb3340699dd54612fc172f09', 'request_id': 'req-85d2590a-3b51-4781-9807-7d0386f7efad'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:49.429397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109b09aacb3340699dd54612fc172f09', 'request_id': 'req-85d2590a-3b51-4781-9807-7d0386f7efad'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:49.454508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] The token cache is being invalidate because project 109b09aacb3340699dd54612fc172f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:30:49.455128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:49.468714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:49.468714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 851/1658] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:30:48 2022] DELETE /identity/v3/projects/109b09aacb3340699dd54612fc172f09 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:49.470594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:49.477101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:49.858403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052915d-4cda-49e6-bacb-df12f37c1566 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:49.868902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2590a-3b51-4781-9807-7d0386f7efad admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:49.868902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c041-7724-4979-9e99-a821d633d288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:49.868902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c041-7724-4979-9e99-a821d633d288 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.868902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c041-7724-4979-9e99-a821d633d288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.870262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c041-7724-4979-9e99-a821d633d288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.870262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f475c041-7724-4979-9e99-a821d633d288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:49.907292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:49.908007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.908297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.908588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.923005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:49.974368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c041-7724-4979-9e99-a821d633d288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:49.993310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c041-7724-4979-9e99-a821d633d288 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:49.993310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 852/1659] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:49.993310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f3a3-bcd1-4ef2-a7bd-6480ea13b04e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.993310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f3a3-bcd1-4ef2-a7bd-6480ea13b04e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.993310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f3a3-bcd1-4ef2-a7bd-6480ea13b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:50.058445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c4c0f3a3-bcd1-4ef2-a7bd-6480ea13b04e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:50.059780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c4c0f3a3-bcd1-4ef2-a7bd-6480ea13b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:50.097656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 853/1660] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:50.106293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea43a10-f490-4e5e-9340-00099a2abf69 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:50.106606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea43a10-f490-4e5e-9340-00099a2abf69 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:50.106867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea43a10-f490-4e5e-9340-00099a2abf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:50.156794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7ea43a10-f490-4e5e-9340-00099a2abf69 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:50.168428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7ea43a10-f490-4e5e-9340-00099a2abf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:50.192761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:50.197891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 854/1661] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:50.203433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea43a10-f490-4e5e-9340-00099a2abf69 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:50.212957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:50.225439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea43a10-f490-4e5e-9340-00099a2abf69 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:50.242649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:50.243536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:50.250699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:50.250699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:50.250699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:50.250699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:50.250699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:50.263704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 808/1662] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1025 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:50.292122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 855/1663] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:50.293314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:50.327939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04355b-5822-4976-ac4c-95b967f5c8cb service nova] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:50.340829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:50.350932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:50.351250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:50.351511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:50.352295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:50.358535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:50.496600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 809/1664] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:50 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:50.498074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:50.520772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc6d8-2862-48b3-809e-881453cce796 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:50.682831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:50.683629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:50.684044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:50.684444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:50.685363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:50.687977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:50.811605 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 856/1665] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:50 2022] POST /identity/v3/users => generated 291 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:30:50.814720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:50.873636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2a6b-db79-4933-91b6-8d36849d0487 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:50.886628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:50.887324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:50.887634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:50.890102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:50.890900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:50.904489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:50.941593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 810/1666] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:50.943132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:51.003261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5132189-a0dc-4ea6-81a8-21c3b2aafec7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:51.046466 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b8e4a-b548-4190-b8bc-9e47dba46b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:51.047733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8e4a-b548-4190-b8bc-9e47dba46b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.048023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8e4a-b548-4190-b8bc-9e47dba46b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.049706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8e4a-b548-4190-b8bc-9e47dba46b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.073065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b8e4a-b548-4190-b8bc-9e47dba46b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:51.086201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b8e4a-b548-4190-b8bc-9e47dba46b30 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:51.145563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 857/1667] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:51.148512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:51.169445 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f680-ba31-4bbc-8ffc-8fb3b0ab509c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:51.233500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4c1c6-348a-4ad9-9e6a-93882a34596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:51.235739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4c1c6-348a-4ad9-9e6a-93882a34596b admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.236397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4c1c6-348a-4ad9-9e6a-93882a34596b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.236992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4c1c6-348a-4ad9-9e6a-93882a34596b admin admin] PATH_INFO: `/v3/projects/232e69d421ce4403adf078b04b817b56/users/fee0b2cc638141b885a940b2b279672f/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.316703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4c1c6-348a-4ad9-9e6a-93882a34596b admin admin] RBAC: Authorizing `identity:create_grant(project_id=232e69d421ce4403adf078b04b817b56, user_id=fee0b2cc638141b885a940b2b279672f, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:51.321066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4c1c6-348a-4ad9-9e6a-93882a34596b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:51.450398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 811/1668] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:51 2022] PUT /identity/v3/projects/232e69d421ce4403adf078b04b817b56/users/fee0b2cc638141b885a940b2b279672f/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:51.460408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b45e-c161-4035-8817-303dcb1d1fbe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.460692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b45e-c161-4035-8817-303dcb1d1fbe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.461067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b45e-c161-4035-8817-303dcb1d1fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.635645 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c586b45e-c161-4035-8817-303dcb1d1fbe None None] MFA Rules not processed for user `fee0b2cc638141b885a940b2b279672f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:51.644920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c586b45e-c161-4035-8817-303dcb1d1fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:51.854942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 858/1669] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:51.859136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b45e-c161-4035-8817-303dcb1d1fbe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:51.859387 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.860689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.860689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.934096 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] MFA Rules not processed for user `9c25e83af7604455bad1d7c0ee1c0122`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:51.938915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:52.160258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b45e-c161-4035-8817-303dcb1d1fbe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:52.170919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:52.173583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:52.173583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:52.173583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:52.173583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:52.177178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:52.185822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 812/1670] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 5 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:52.285661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:52.287779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:52.324283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371c891-02be-4f2d-b851-b9671cb80261 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:52.339696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:52.340329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 859/1671] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:51 2022] POST /identity/v3/projects => generated 381 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:30:52.340987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:52.342856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:52.343393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:52.348401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:52.372110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:52.373749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:52.397689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 813/1672] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:30:52.553870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:52.555659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:52.609723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c16a2-d77a-4540-bd1a-3c909927f613 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:52.696729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7cca9-ca5e-4a32-aeb4-f8e24e31e613 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:52.734156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:52.737019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:52.737406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:52.737886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:52.739735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:52.743887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:52.826041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:52.828943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:52.831194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:52.839748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] PATH_INFO: `/v3/projects/54befb77e0c042eb9a45ea82c966d217` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:52.839748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54befb77e0c042eb9a45ea82c966d217)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:52.839748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: WARNING py.warnings [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:30:52.839748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: warnings.warn(msg) May 05 15:30:52.839748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: May 05 15:30:52.839748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:52.870506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 860/1673] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:52 2022] POST /identity/v3/users => generated 297 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:52.871819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:52.926611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431a01-345c-4acc-b577-1f7b1443154e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:52.960727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:52.961511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:52.961864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:52.962228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:52.963051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:52.966383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:53.025232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 861/1674] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:53.029373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:53.056512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba2a5-3833-4121-9f96-7ace8b82b53a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:53.079563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:53.084136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:53.084136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:53.084136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] PATH_INFO: `/v3/projects/e0a0e7613e214f89be5695b0e77f82db/users/6153666441504d689af1dc3f1431f344/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:53.154528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54befb77e0c042eb9a45ea82c966d217', 'request_id': 'req-9daf3158-2cfd-4360-ac12-31188e180c2b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:53.190248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54befb77e0c042eb9a45ea82c966d217', 'request_id': 'req-9daf3158-2cfd-4360-ac12-31188e180c2b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:53.280593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54befb77e0c042eb9a45ea82c966d217', 'request_id': 'req-9daf3158-2cfd-4360-ac12-31188e180c2b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:53.303658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] The token cache is being invalidate because project 54befb77e0c042eb9a45ea82c966d217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:30:53.304211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:53.306904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:53.313442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 814/1675] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:30:52 2022] DELETE /identity/v3/projects/54befb77e0c042eb9a45ea82c966d217 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:30:53.318568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:53.321149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:53.660347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a0e7613e214f89be5695b0e77f82db, user_id=6153666441504d689af1dc3f1431f344, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:53.665077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:53.690983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf3158-2cfd-4360-ac12-31188e180c2b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:53.700395 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:53.701657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:53.702097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:53.703134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] PATH_INFO: `/v3/projects/c568bdf23881488d8b4d60af4666f526` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:53.705097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c568bdf23881488d8b4d60af4666f526)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:53.708396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:53.750042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 862/1676] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:53 2022] PUT /identity/v3/projects/e0a0e7613e214f89be5695b0e77f82db/users/6153666441504d689af1dc3f1431f344/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:53.753238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:53.760413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:53.927006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c568bdf23881488d8b4d60af4666f526', 'request_id': 'req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:53.962954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c568bdf23881488d8b4d60af4666f526', 'request_id': 'req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.047084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d7b9-78fc-43d8-832b-4742f109fd61 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:54.227795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:54.259233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.259233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.259233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] PATH_INFO: `/v3/users/524e7249df1547c8ac6747f29840880c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:54.259233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524e7249df1547c8ac6747f29840880c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:54.259233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:54.525180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c568bdf23881488d8b4d60af4666f526', 'request_id': 'req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.602260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] The token cache is being invalidate because project c568bdf23881488d8b4d60af4666f526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:30:54.607956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.612616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6d71056b-a8cd-4b63-af46-94ebefd9a5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.624406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 815/1677] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:30:53 2022] DELETE /identity/v3/projects/c568bdf23881488d8b4d60af4666f526 => generated 0 bytes in 1305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:54.640959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7eff-1790-4f97-96fc-000753683a44 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.640959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7eff-1790-4f97-96fc-000753683a44 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.640959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7eff-1790-4f97-96fc-000753683a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:54.671874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524e7249df1547c8ac6747f29840880c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.676665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524e7249df1547c8ac6747f29840880c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.713592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-517e7eff-1790-4f97-96fc-000753683a44 None None] MFA Rules not processed for user `68239e70245a4922b8c7961dd8962baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:54.720473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-517e7eff-1790-4f97-96fc-000753683a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:54.808532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524e7249df1547c8ac6747f29840880c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.824353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524e7249df1547c8ac6747f29840880c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.826478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524e7249df1547c8ac6747f29840880c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:54.938883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 863/1678] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:30:53 2022] DELETE /identity/v3/users/524e7249df1547c8ac6747f29840880c => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:54.940477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:54.949187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:54.961863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 816/1679] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:54.963329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820502-d9ed-4416-9e35-7bcc97576fa0 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.972731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820502-d9ed-4416-9e35-7bcc97576fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.973136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820502-d9ed-4416-9e35-7bcc97576fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.060189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-df820502-d9ed-4416-9e35-7bcc97576fa0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:55.064305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-df820502-d9ed-4416-9e35-7bcc97576fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:55.306952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 817/1680] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:55.310923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2fd7d-0d52-40df-94b3-b6c7ff6c8e5a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:55.313229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2fd7d-0d52-40df-94b3-b6c7ff6c8e5a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:55.316134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2fd7d-0d52-40df-94b3-b6c7ff6c8e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.369339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fcd9-7eab-4b12-a32f-29a45cd1c538 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:55.401730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c0e2fd7d-0d52-40df-94b3-b6c7ff6c8e5a None None] MFA Rules not processed for user `68239e70245a4922b8c7961dd8962baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:55.408617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b2029-6486-498e-87b3-b78cea8b9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:55.408617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2029-6486-498e-87b3-b78cea8b9fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:55.408617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2029-6486-498e-87b3-b78cea8b9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:55.408987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c0e2fd7d-0d52-40df-94b3-b6c7ff6c8e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:55.409061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2029-6486-498e-87b3-b78cea8b9fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.409061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b2029-6486-498e-87b3-b78cea8b9fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:55.409061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b2029-6486-498e-87b3-b78cea8b9fc4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:55.447193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 864/1681] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:55.449013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd451-fe02-4f03-960c-433a290b31e8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:55.451320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd451-fe02-4f03-960c-433a290b31e8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:55.456295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd451-fe02-4f03-960c-433a290b31e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.535201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-161cd451-fe02-4f03-960c-433a290b31e8 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:55.536502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-161cd451-fe02-4f03-960c-433a290b31e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:55.558765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 865/1682] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:55.559798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd451-fe02-4f03-960c-433a290b31e8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:55.620822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd451-fe02-4f03-960c-433a290b31e8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:55.638888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 818/1683] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:55.642115 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2fd7d-0d52-40df-94b3-b6c7ff6c8e5a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:55.657883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2fd7d-0d52-40df-94b3-b6c7ff6c8e5a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:55.662922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:55.664131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:55.664845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:55.666414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] PATH_INFO: `/v3/projects/e0a0e7613e214f89be5695b0e77f82db/users/6153666441504d689af1dc3f1431f344/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.687114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:55.690006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a0e7613e214f89be5695b0e77f82db, user_id=6153666441504d689af1dc3f1431f344, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:55.693151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:55.695016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:55.695323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.696240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:55.696551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:55.705114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:55.733052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:55.776497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 819/1684] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:55.787711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:55.808739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:55.814223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 866/1685] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:55 2022] PUT /identity/v3/projects/e0a0e7613e214f89be5695b0e77f82db/users/6153666441504d689af1dc3f1431f344/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:55.825944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:56.401090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc266cd-f982-4b1b-a035-26efcd5b6974 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:56.410364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98e79-dcc7-4816-a9d2-310bd5d46157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:56.412403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98e79-dcc7-4816-a9d2-310bd5d46157 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:56.412955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98e79-dcc7-4816-a9d2-310bd5d46157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:56.413726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98e79-dcc7-4816-a9d2-310bd5d46157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:56.414724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b98e79-dcc7-4816-a9d2-310bd5d46157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:56.418197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b98e79-dcc7-4816-a9d2-310bd5d46157 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:56.506951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f833-ccd0-4814-bec5-45061ed4895f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:56.601640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 867/1686] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:55 2022] POST /identity/v3/projects => generated 375 bytes in 779 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:56.601640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:56.601640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:56.601640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:56.674152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] MFA Rules not processed for user `6153666441504d689af1dc3f1431f344`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:56.678169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:56.705260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:56.706619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:56.707722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:56.708256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:56.982211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 868/1687] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:56.983062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:56.987409 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:56.989134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:56.991160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:57.043946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 820/1688] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:57.045004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:57.052862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:57.118324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62aaa-5e5d-4bb0-a324-85a7f3e34026 service nova] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:57.238886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfa4c4-641e-4784-b0b5-c46d2117fefb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:57.262296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:57.263267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:57.263453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:57.264005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] PATH_INFO: `/v3/users/806bb02a3f9e45e6895b0f67f1fee7bd` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:57.270357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806bb02a3f9e45e6895b0f67f1fee7bd)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:57.276735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:57.424989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:57.428945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:57.429473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:57.430595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] PATH_INFO: `/v3/projects/6c1d7cc9bbdf4457ba79a9522a774d64` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:57.437723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1d7cc9bbdf4457ba79a9522a774d64)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:57.461729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:57.763981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1d7cc9bbdf4457ba79a9522a774d64', 'request_id': 'req-9d783031-d6b7-4127-aaf2-9714896fcd51'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:57.772685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806bb02a3f9e45e6895b0f67f1fee7bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:57.777534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806bb02a3f9e45e6895b0f67f1fee7bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:57.812881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1d7cc9bbdf4457ba79a9522a774d64', 'request_id': 'req-9d783031-d6b7-4127-aaf2-9714896fcd51'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:57.893318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806bb02a3f9e45e6895b0f67f1fee7bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:57.911255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806bb02a3f9e45e6895b0f67f1fee7bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:57.912977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806bb02a3f9e45e6895b0f67f1fee7bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:58.010085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1d7cc9bbdf4457ba79a9522a774d64', 'request_id': 'req-9d783031-d6b7-4127-aaf2-9714896fcd51'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:58.016990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 869/1689] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:30:56 2022] DELETE /identity/v3/users/806bb02a3f9e45e6895b0f67f1fee7bd => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:58.026717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.029651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.045936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] The token cache is being invalidate because project 6c1d7cc9bbdf4457ba79a9522a774d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:30:58.046548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:58.047668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:30:58.050908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 821/1690] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:30:57 2022] DELETE /identity/v3/projects/6c1d7cc9bbdf4457ba79a9522a774d64 => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:58.052356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.055696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.203670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783031-d6b7-4127-aaf2-9714896fcd51 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.260334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3795a46-3309-49b2-af33-d4a182adf8d9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.278627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b8840-b420-4e16-a517-296726614d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.280241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8840-b420-4e16-a517-296726614d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.282156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8840-b420-4e16-a517-296726614d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.283259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8840-b420-4e16-a517-296726614d85 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.284738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b8840-b420-4e16-a517-296726614d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.303088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b8840-b420-4e16-a517-296726614d85 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.367794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d69c-be54-484c-aa0a-234d71dd2fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.368753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d69c-be54-484c-aa0a-234d71dd2fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.369197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d69c-be54-484c-aa0a-234d71dd2fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.369821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d69c-be54-484c-aa0a-234d71dd2fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.372174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4f20d69c-be54-484c-aa0a-234d71dd2fc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.447626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 870/1691] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:58 2022] POST /identity/v3/users => generated 288 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:58.449497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57de5a-78e0-4f27-a899-2e0e3dbb450a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.449956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57de5a-78e0-4f27-a899-2e0e3dbb450a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.450522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57de5a-78e0-4f27-a899-2e0e3dbb450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.506569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0e57de5a-78e0-4f27-a899-2e0e3dbb450a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:58.519857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0e57de5a-78e0-4f27-a899-2e0e3dbb450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.548249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 871/1692] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:58.549928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.550300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.551058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.601230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d69c-be54-484c-aa0a-234d71dd2fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.602899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d69c-be54-484c-aa0a-234d71dd2fc8 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.608066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:58.621707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.629964 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 822/1693] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:58.631320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6049f-f242-4079-b3be-e1ca9282af3c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.636370 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6049f-f242-4079-b3be-e1ca9282af3c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.636774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6049f-f242-4079-b3be-e1ca9282af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.657875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 872/1694] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:58.665558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.668774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.700672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-95e6049f-f242-4079-b3be-e1ca9282af3c None None] MFA Rules not processed for user `65b7373b2c664dc4a054b8943d1d231c`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:58.702353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-95e6049f-f242-4079-b3be-e1ca9282af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.730724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291ca54-69bf-4063-929b-184fe71c53d3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.774383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.775721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.795978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.796409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.802771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.811246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.867792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 873/1695] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:58.868895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.887796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.918068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 823/1696] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:58.918068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274342e-af2f-48b1-bc71-d433bc561a74 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.918704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274342e-af2f-48b1-bc71-d433bc561a74 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.919837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274342e-af2f-48b1-bc71-d433bc561a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.990535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9274342e-af2f-48b1-bc71-d433bc561a74 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:58.990535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9274342e-af2f-48b1-bc71-d433bc561a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:59.022321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 824/1697] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:59.025376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d847e-9510-488d-9381-80f61d53e275 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.025880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d847e-9510-488d-9381-80f61d53e275 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.026342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d847e-9510-488d-9381-80f61d53e275 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.028125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 825/1698] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:30:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:59.032484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d847e-9510-488d-9381-80f61d53e275 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:59.067700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d847e-9510-488d-9381-80f61d53e275 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:59.075574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:59.091297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.092014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.092514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.094135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:59.098371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:59.131343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 826/1699] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:30:59.136138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:59.161765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed046-1499-49e1-877e-73d9b6e6951c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:59.165799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462412b-7224-411c-909f-2ba4a18fc4b8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:59.183958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1d2ea-9c72-4937-afe5-f3d256ba039b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:59.183958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d2ea-9c72-4937-afe5-f3d256ba039b service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.183958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d2ea-9c72-4937-afe5-f3d256ba039b service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.183958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d2ea-9c72-4937-afe5-f3d256ba039b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.184939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-83a1d2ea-9c72-4937-afe5-f3d256ba039b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:59.194655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:59.196038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.196396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.196607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.240951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:59.247254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:59.286082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 874/1700] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:59.287150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:59.310401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1d2ea-9c72-4937-afe5-f3d256ba039b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:59.312567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1d2ea-9c72-4937-afe5-f3d256ba039b service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:59.325827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 827/1701] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:30:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:59.329697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee904-2fac-468a-ab69-e35b1215d2cc None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.329697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee904-2fac-468a-ab69-e35b1215d2cc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.329697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee904-2fac-468a-ab69-e35b1215d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.339319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990946-02fd-4e4c-8784-1f252e49f43f service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:59.354448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-cd3ee904-2fac-468a-ab69-e35b1215d2cc None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:59.362302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:59.362302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.362302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.362302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.362698 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:59.362698 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:59.364931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:59.365934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cd3ee904-2fac-468a-ab69-e35b1215d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:59.387718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 875/1702] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:59.389062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:59.408053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217bac8-4a7c-4275-bf4c-4db8e67b9729 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:59.416269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bdeec-e35e-44d2-a07c-2253966da6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:59.416503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bdeec-e35e-44d2-a07c-2253966da6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.416978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bdeec-e35e-44d2-a07c-2253966da6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.417327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bdeec-e35e-44d2-a07c-2253966da6d1 admin admin] PATH_INFO: `/v3/projects/36d9c067c7174c4b9f1b1c8ffd1f7131/users/8f1ca31c9b7745aba50a71dbc0e47ebd/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.445228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bdeec-e35e-44d2-a07c-2253966da6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d9c067c7174c4b9f1b1c8ffd1f7131, user_id=8f1ca31c9b7745aba50a71dbc0e47ebd, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:59.452757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bdeec-e35e-44d2-a07c-2253966da6d1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:59.498652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 828/1703] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:59.499661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ee904-2fac-468a-ab69-e35b1215d2cc None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:59.513430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ee904-2fac-468a-ab69-e35b1215d2cc None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:59.522901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:59.523544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.524204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.524623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.525443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:59.527675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:59.579626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 876/1704] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:30:59 2022] PUT /identity/v3/projects/36d9c067c7174c4b9f1b1c8ffd1f7131/users/8f1ca31c9b7745aba50a71dbc0e47ebd/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:59.587948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:59.589103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:59.590040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:59.686939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 829/1705] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:30:59 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:59.689705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:59.722834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] MFA Rules not processed for user `8f1ca31c9b7745aba50a71dbc0e47ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:59.728592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:00.085182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 877/1706] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:00.086096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:00.093921 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20139fb5-3d03-44f9-821a-ca57a44c4663 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:00.094492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:00.134951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdcd8c-1763-45e0-91f8-5dc8d2576ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:00.153534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdcd8c-1763-45e0-91f8-5dc8d2576ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.156105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdcd8c-1763-45e0-91f8-5dc8d2576ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.162616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdcd8c-1763-45e0-91f8-5dc8d2576ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.162616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdcd8c-1763-45e0-91f8-5dc8d2576ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:00.171516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdcd8c-1763-45e0-91f8-5dc8d2576ac8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:00.359821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 830/1707] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:30:59 2022] POST /identity/v3/users => generated 294 bytes in 672 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:00.361290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c941e6-cbf0-439b-aa4f-694024625dee None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.361578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c941e6-cbf0-439b-aa4f-694024625dee None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.361860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c941e6-cbf0-439b-aa4f-694024625dee None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.370082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 831/1708] 10.222.0.55 () {54 vars in 912 bytes} [Thu May 5 15:31:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:00.371623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c941e6-cbf0-439b-aa4f-694024625dee None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:00.387677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c941e6-cbf0-439b-aa4f-694024625dee None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:00.403105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c490e2-c845-4356-a687-f5f562f32b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:00.403105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c490e2-c845-4356-a687-f5f562f32b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.403105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c490e2-c845-4356-a687-f5f562f32b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.403105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c490e2-c845-4356-a687-f5f562f32b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.404562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c490e2-c845-4356-a687-f5f562f32b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:00.404562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c490e2-c845-4356-a687-f5f562f32b8a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:00.417772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 832/1709] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:00.437915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a878926-6df2-4c6b-8aa1-4d37db67fdd3 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.437915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a878926-6df2-4c6b-8aa1-4d37db67fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.437915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a878926-6df2-4c6b-8aa1-4d37db67fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.457101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7a878926-6df2-4c6b-8aa1-4d37db67fdd3 None None] MFA Rules not processed for user `9c25e83af7604455bad1d7c0ee1c0122`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:00.458998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7a878926-6df2-4c6b-8aa1-4d37db67fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:00.563621 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025bb36-138e-4a84-a1c5-bcf1fb8819e3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:00.574717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 833/1710] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:31:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:00.576165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a878926-6df2-4c6b-8aa1-4d37db67fdd3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:00.589996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a878926-6df2-4c6b-8aa1-4d37db67fdd3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:00.596361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:00.596890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.597290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.597739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.598606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:00.601426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:00.607243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17acada-d965-4850-9b99-fd6d507f0cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:00.607973 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acada-d965-4850-9b99-fd6d507f0cdd service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.608444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acada-d965-4850-9b99-fd6d507f0cdd service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.608935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acada-d965-4850-9b99-fd6d507f0cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.642070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 834/1711] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:00.647032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:00.676076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9cda-4a80-42e0-82a3-2b1be63958b4 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:00.709583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:00.710183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.710576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.711565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] PATH_INFO: `/v3/projects/f85ab18f85de43c3888cf3691cc72ba6/users/0d36a648923d4b77bc0402c09e0d2a99/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.778449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85ab18f85de43c3888cf3691cc72ba6, user_id=0d36a648923d4b77bc0402c09e0d2a99, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:00.782296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:00.904130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17acada-d965-4850-9b99-fd6d507f0cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:00.906511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17acada-d965-4850-9b99-fd6d507f0cdd service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:00.908151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 835/1712] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:00 2022] PUT /identity/v3/projects/f85ab18f85de43c3888cf3691cc72ba6/users/0d36a648923d4b77bc0402c09e0d2a99/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:00.909302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:00.921107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:00.946759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 878/1713] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 861 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:00.951336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959e35-9f19-4254-9426-5084999eceed None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.951336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959e35-9f19-4254-9426-5084999eceed None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.951336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959e35-9f19-4254-9426-5084999eceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.079574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-95959e35-9f19-4254-9426-5084999eceed None None] MFA Rules not processed for user `0d36a648923d4b77bc0402c09e0d2a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:01.086741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-95959e35-9f19-4254-9426-5084999eceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:01.168812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bf438-d79e-4a76-8c9b-4686ea1dc28f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:01.223823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:01.229682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:01.238256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:01.238923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.276662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:01.282353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:01.333618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 836/1714] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:01.471100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 879/1715] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:01.480210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:01.774483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be716e1-c416-452a-bc82-eb29c26e1628 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:01.817231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:01.818134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:01.818518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:01.818808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.820047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:01.822783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:02.033333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 837/1716] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:01 2022] POST /identity/v3/projects => generated 387 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:02.037508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959e35-9f19-4254-9426-5084999eceed None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:02.071206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959e35-9f19-4254-9426-5084999eceed None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:02.400212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:02.402098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:02.403940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:02.407088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:02.410676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:02.423984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:02.433361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:02.433361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:02.515334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999405-5905-4a9b-90b6-0660ca743389 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:02.538578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:02.544477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:02.547273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:02.547681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] PATH_INFO: `/v3/projects/1b5242bdff614324ba88f8dddc64c136` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:02.553153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5242bdff614324ba88f8dddc64c136)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:02.568420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:02.677453 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 880/1717] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:02 2022] POST /identity/v3/users => generated 300 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:02.681602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:02.763078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f1b3-97d9-480a-9563-c27e2e2db805 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:02.818104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:02.819198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:02.820433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:02.821867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:02.823558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:02.850182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:02.886752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5242bdff614324ba88f8dddc64c136', 'request_id': 'req-1edab8ae-2dcb-40bc-9603-33f698a3199e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:02.919703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 881/1718] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:02.928924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:02.933279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5242bdff614324ba88f8dddc64c136', 'request_id': 'req-1edab8ae-2dcb-40bc-9603-33f698a3199e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:02.978011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394a77c-c06b-44fc-b7b2-45e5fbc8df28 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:03.069898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5242bdff614324ba88f8dddc64c136', 'request_id': 'req-1edab8ae-2dcb-40bc-9603-33f698a3199e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:03.116505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] The token cache is being invalidate because project 1b5242bdff614324ba88f8dddc64c136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:03.117097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:03.128837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1edab8ae-2dcb-40bc-9603-33f698a3199e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:03.137223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 838/1719] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:02 2022] DELETE /identity/v3/projects/1b5242bdff614324ba88f8dddc64c136 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:03.142403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f551-27d1-4be5-abea-e35036da6b45 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:03.142732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f551-27d1-4be5-abea-e35036da6b45 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:03.143022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f551-27d1-4be5-abea-e35036da6b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:03.225139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:03.228946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:03.230603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-93a3f551-27d1-4be5-abea-e35036da6b45 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:03.230765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:03.232508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] PATH_INFO: `/v3/projects/b67748bf692f4a61aad8d06b9f279fa2/users/dfc4b65924af4e2f839e92d74e26e43f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:03.238577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-93a3f551-27d1-4be5-abea-e35036da6b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:03.273306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 839/1720] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:03.281108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:03.281437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:03.281671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:03.351573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:03.353046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:03.366037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67748bf692f4a61aad8d06b9f279fa2, user_id=dfc4b65924af4e2f839e92d74e26e43f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:03.377119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 840/1721] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:03.380444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:03.380711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:03.392057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:03.584398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee0bd-7b0e-4d53-b1fd-c410bb6d6b1a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:03.587556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 882/1722] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:02 2022] PUT /identity/v3/projects/b67748bf692f4a61aad8d06b9f279fa2/users/dfc4b65924af4e2f839e92d74e26e43f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:03.589111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:03.740384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:03.743458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:03.743763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:03.744144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:03.752656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:03.793278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:03.796763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:03.832228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce650b-fc88-4e51-a17c-f628ad490ef5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:03.843941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:03.845562 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:03.846295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 841/1723] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:03.846704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:03.847208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:03.848352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:03.849282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:03.849716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:03.851758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:03.864544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:03.887006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a79e50-05b7-4bb2-9fe3-4c1b50a29563 service nova] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:03.895757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224dd01-72ef-46a6-a79b-946299cdb7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:03.904388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224dd01-72ef-46a6-a79b-946299cdb7da admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:03.904388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224dd01-72ef-46a6-a79b-946299cdb7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:03.904388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224dd01-72ef-46a6-a79b-946299cdb7da admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:03.904388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224dd01-72ef-46a6-a79b-946299cdb7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:03.904388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224dd01-72ef-46a6-a79b-946299cdb7da admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:03.918151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 883/1724] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:03.930084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 842/1725] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:03.932183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb215-0ea6-4f5f-94aa-f8e0cd78cd1f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:03.933180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb215-0ea6-4f5f-94aa-f8e0cd78cd1f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:03.934395 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb215-0ea6-4f5f-94aa-f8e0cd78cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:03.935184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:03.952797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:03.972170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b0bdb215-0ea6-4f5f-94aa-f8e0cd78cd1f None None] MFA Rules not processed for user `2ca44c6702304a53a176bebdb6ccbe3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:03.977673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b0bdb215-0ea6-4f5f-94aa-f8e0cd78cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:04.018890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62997f13-dc43-48c9-ad0e-01a9a1fb9da8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:04.040763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:04.043103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.044401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.046171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:04.073680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:04.218789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 843/1726] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:04.219872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb215-0ea6-4f5f-94aa-f8e0cd78cd1f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:04.267097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb215-0ea6-4f5f-94aa-f8e0cd78cd1f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:04.296355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:04.297016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.297295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.297556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:04.298285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:04.300302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:04.321130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:04.344486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:04.418483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 884/1727] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:04.424380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:04.465288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c56e2-3450-4bc8-9a04-3f98e0136598 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:04.476150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 844/1728] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:04 2022] POST /identity/v3/projects => generated 355 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:04.478249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:04.807293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712a725-9e7e-49d0-baac-b4f4d3fed23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:04.810033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5d65f-4325-4733-9b10-ccc94edd1d20 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:04.814995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712a725-9e7e-49d0-baac-b4f4d3fed23a admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.814995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712a725-9e7e-49d0-baac-b4f4d3fed23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.815237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712a725-9e7e-49d0-baac-b4f4d3fed23a admin admin] PATH_INFO: `/v3/projects/b67748bf692f4a61aad8d06b9f279fa2/users/dfc4b65924af4e2f839e92d74e26e43f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:04.826577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712a725-9e7e-49d0-baac-b4f4d3fed23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67748bf692f4a61aad8d06b9f279fa2, user_id=dfc4b65924af4e2f839e92d74e26e43f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:04.858575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7b95-dcb3-49bc-8e74-57d86320b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:04.859491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7b95-dcb3-49bc-8e74-57d86320b717 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.859923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7b95-dcb3-49bc-8e74-57d86320b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.860343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7b95-dcb3-49bc-8e74-57d86320b717 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:04.861217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad7b95-dcb3-49bc-8e74-57d86320b717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:04.863338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad7b95-dcb3-49bc-8e74-57d86320b717 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:04.867856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712a725-9e7e-49d0-baac-b4f4d3fed23a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:04.944213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 885/1729] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:04 2022] PUT /identity/v3/projects/b67748bf692f4a61aad8d06b9f279fa2/users/dfc4b65924af4e2f839e92d74e26e43f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:04.954367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01681e-868c-411d-8f2a-87f12b18a1b0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.954894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01681e-868c-411d-8f2a-87f12b18a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.959099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01681e-868c-411d-8f2a-87f12b18a1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:05.001497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 845/1730] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:04 2022] POST /identity/v3/users => generated 278 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:05.004921 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:05.008721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:05.009236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:05.022283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9c01681e-868c-411d-8f2a-87f12b18a1b0 None None] MFA Rules not processed for user `68239e70245a4922b8c7961dd8962baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:05.023587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9c01681e-868c-411d-8f2a-87f12b18a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:05.146420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] MFA Rules not processed for user `dfc4b65924af4e2f839e92d74e26e43f`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:05.150174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:05.295535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 886/1731] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:05.298369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01681e-868c-411d-8f2a-87f12b18a1b0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:05.462843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 846/1732] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:05.481655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:05.485049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:05.684880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01681e-868c-411d-8f2a-87f12b18a1b0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:05.742209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:05.742923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:05.743208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:05.743513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:05.749674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:05.759304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:05.839410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1419-d1a6-4993-9735-40deab85d585 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:05.843853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 887/1733] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 549 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:05.850074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:05.872261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7db2c5-bb67-42e0-a0a3-81ebb57dec4b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:05.876308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:05.879039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:05.879372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:05.884106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:05.904507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:05.916332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:05.916852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:05.920116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:05.922965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:05.930277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:05.937759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:05.942841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:05.968263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 888/1734] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:05.983151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 847/1735] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:05.983319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:06.021775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7473e5-e403-4c86-a4c7-9b7d697cd065 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:06.072431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be06654-b7cd-4e21-ac04-e8e0b9de4222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:06.078203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06654-b7cd-4e21-ac04-e8e0b9de4222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:06.078770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06654-b7cd-4e21-ac04-e8e0b9de4222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:06.085653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06654-b7cd-4e21-ac04-e8e0b9de4222 admin admin] PATH_INFO: `/v3/projects/e12e4d877fda4a6da7abdb93cedd6438/users/8bcdb8001413481fbe4089ee9449f59c/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:06.132831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:06.166125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d705c-2d45-4d41-9561-b678d2b1b697 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:06.190096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be06654-b7cd-4e21-ac04-e8e0b9de4222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12e4d877fda4a6da7abdb93cedd6438, user_id=8bcdb8001413481fbe4089ee9449f59c, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:06.190096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be06654-b7cd-4e21-ac04-e8e0b9de4222 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:06.190912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:06.195083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:06.195361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:06.196179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] PATH_INFO: `/v3/users/0d36a648923d4b77bc0402c09e0d2a99` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:06.203956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d36a648923d4b77bc0402c09e0d2a99)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:06.230166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:06.860217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 889/1736] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:05 2022] PUT /identity/v3/projects/e12e4d877fda4a6da7abdb93cedd6438/users/8bcdb8001413481fbe4089ee9449f59c/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:06.874496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb08e-177b-4979-9140-d3fe2fddcee2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:06.874961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb08e-177b-4979-9140-d3fe2fddcee2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:06.908017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb08e-177b-4979-9140-d3fe2fddcee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:07.157411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b5ffb08e-177b-4979-9140-d3fe2fddcee2 None None] MFA Rules not processed for user `8bcdb8001413481fbe4089ee9449f59c`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:07.173500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b5ffb08e-177b-4979-9140-d3fe2fddcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:07.188339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d36a648923d4b77bc0402c09e0d2a99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:07.228547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d36a648923d4b77bc0402c09e0d2a99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:07.397474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d36a648923d4b77bc0402c09e0d2a99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:07.505955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 890/1737] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 631 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:07.506723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffb08e-177b-4979-9140-d3fe2fddcee2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:07.513978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d36a648923d4b77bc0402c09e0d2a99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:07.517231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a6b059-8ede-4184-82e6-5b73c8f2024f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d36a648923d4b77bc0402c09e0d2a99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:07.545614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 848/1738] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:06 2022] DELETE /identity/v3/users/0d36a648923d4b77bc0402c09e0d2a99 => generated 0 bytes in 1413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:07.549235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:07.552043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:07.567313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:07.680482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:07.681995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:07.769087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffb08e-177b-4979-9140-d3fe2fddcee2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:07.921343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 849/1739] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:07.933272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:07.935089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:07.966735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:07.968263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:07.969672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:07.970631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:07.971767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:07.974997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:08.198331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6d2cb-6602-451d-bbf3-b95f7f225f5a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:08.221913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:08.222596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:08.222882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:08.223819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:08.254240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:08.255764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:08.269844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 850/1740] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:08.518760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:08.520439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:08.528346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 891/1741] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:07 2022] POST /identity/v3/projects => generated 357 bytes in 1022 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:08.561241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0347-b0fc-422c-91eb-20397b5fd91f service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:08.679934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:08.684526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:08.769761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:08.769939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:08.770271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:08.771394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:08.779996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:08.782405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:08.838251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b2fd-7230-4b1b-9b23-c44ccfd020c2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:08.851723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:08.851723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:08.851723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:08.851723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] PATH_INFO: `/v3/users/8f1ca31c9b7745aba50a71dbc0e47ebd` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:08.854026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1ca31c9b7745aba50a71dbc0e47ebd)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:08.857994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:08.925272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 851/1742] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:08 2022] POST /identity/v3/users => generated 285 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:08.935564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:08.968791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc64c55-f417-42dc-9b7a-fec6a695c2e2 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:08.982333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:08.983130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:08.985130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:08.985429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:08.986210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:08.987964 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:09.020220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 852/1743] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:09.025161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:09.044826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac989a-ab80-49eb-9611-edbde31db791 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:09.063796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:09.065027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:09.065498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:09.065925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] PATH_INFO: `/v3/projects/e20d2936f9e44fd795344b4a6752bf60/users/cfbca69b78bc4f299e2a75aaa9fa5883/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:09.100232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20d2936f9e44fd795344b4a6752bf60, user_id=cfbca69b78bc4f299e2a75aaa9fa5883, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:09.103554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:09.161042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1ca31c9b7745aba50a71dbc0e47ebd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.161746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1ca31c9b7745aba50a71dbc0e47ebd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.248397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1ca31c9b7745aba50a71dbc0e47ebd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.260376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 853/1744] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:09 2022] PUT /identity/v3/projects/e20d2936f9e44fd795344b4a6752bf60/users/cfbca69b78bc4f299e2a75aaa9fa5883/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:09.265768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:09.272285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1ca31c9b7745aba50a71dbc0e47ebd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.272383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:09.272467 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1ca31c9b7745aba50a71dbc0e47ebd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.315069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 892/1745] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:08 2022] DELETE /identity/v3/users/8f1ca31c9b7745aba50a71dbc0e47ebd => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:09.318843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:09.321279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:09.411533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314521-612d-4769-8146-533e3c652b4b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:09.483396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21ffa9-a3e0-4b70-a3d6-b48f63c54e26 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:09.491309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22228d-53fd-44a1-94e4-94ce67ac6637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:09.495977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22228d-53fd-44a1-94e4-94ce67ac6637 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:09.512172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22228d-53fd-44a1-94e4-94ce67ac6637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:09.512172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22228d-53fd-44a1-94e4-94ce67ac6637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:09.512172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22228d-53fd-44a1-94e4-94ce67ac6637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:09.518403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22228d-53fd-44a1-94e4-94ce67ac6637 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:09.553227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 893/1746] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:09.554399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b161-512e-467f-a6e1-9cea4a6de8bc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:09.554691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b161-512e-467f-a6e1-9cea4a6de8bc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:09.555035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b161-512e-467f-a6e1-9cea4a6de8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:09.577690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:09.578910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:09.579721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:09.580221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] PATH_INFO: `/v3/projects/f85ab18f85de43c3888cf3691cc72ba6` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:09.581431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85ab18f85de43c3888cf3691cc72ba6)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:09.583529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:09.608536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2389b161-512e-467f-a6e1-9cea4a6de8bc None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:09.610416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2389b161-512e-467f-a6e1-9cea4a6de8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:09.631079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 894/1747] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:09.631993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389b161-512e-467f-a6e1-9cea4a6de8bc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:09.647444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389b161-512e-467f-a6e1-9cea4a6de8bc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:09.658257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:09.661664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:09.661664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:09.661664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] PATH_INFO: `/v3/projects/e20d2936f9e44fd795344b4a6752bf60/users/cfbca69b78bc4f299e2a75aaa9fa5883/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:09.664632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20d2936f9e44fd795344b4a6752bf60, user_id=cfbca69b78bc4f299e2a75aaa9fa5883, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:09.669269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:09.698648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 895/1748] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:09 2022] PUT /identity/v3/projects/e20d2936f9e44fd795344b4a6752bf60/users/cfbca69b78bc4f299e2a75aaa9fa5883/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:09.698648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:09.698648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:09.770219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85ab18f85de43c3888cf3691cc72ba6', 'request_id': 'req-2928a15d-a23c-4367-9450-b2ad349d4e51'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.778406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85ab18f85de43c3888cf3691cc72ba6', 'request_id': 'req-2928a15d-a23c-4367-9450-b2ad349d4e51'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.810660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7647c17-0cc8-4f99-b7cb-d295db734cfd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:09.879614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:09.880306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:09.880756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:09.881034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:09.926854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85ab18f85de43c3888cf3691cc72ba6', 'request_id': 'req-2928a15d-a23c-4367-9450-b2ad349d4e51'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.941562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] The token cache is being invalidate because project f85ab18f85de43c3888cf3691cc72ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:09.942336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.942984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2928a15d-a23c-4367-9450-b2ad349d4e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:09.950164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 854/1749] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:09 2022] DELETE /identity/v3/projects/f85ab18f85de43c3888cf3691cc72ba6 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:09.951986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:09.953025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:09.964751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:09.984046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:09.986097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:10.008153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] MFA Rules not processed for user `cfbca69b78bc4f299e2a75aaa9fa5883`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:10.008153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.008363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 896/1750] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:10.008363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:10.014240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.033098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a40b-141e-4509-986e-92a4019388f9 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:10.038947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:10.040143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:10.040813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:10.040813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] PATH_INFO: `/v3/users/dfc4b65924af4e2f839e92d74e26e43f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:10.042845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc4b65924af4e2f839e92d74e26e43f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:10.044887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:10.097442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 855/1751] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:10.105352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:10.111967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.180223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341bb2a-74ce-43c2-9b84-ec0f28c352cc None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:10.184010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22f874-533c-4a18-85c1-9dfe598c8ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:10.184662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f874-533c-4a18-85c1-9dfe598c8ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:10.184942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f874-533c-4a18-85c1-9dfe598c8ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:10.185216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f874-533c-4a18-85c1-9dfe598c8ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:10.194606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22f874-533c-4a18-85c1-9dfe598c8ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:10.196554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22f874-533c-4a18-85c1-9dfe598c8ea1 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:10.207315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 856/1752] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:10.240472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc4b65924af4e2f839e92d74e26e43f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:10.241184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc4b65924af4e2f839e92d74e26e43f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:10.368958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc4b65924af4e2f839e92d74e26e43f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:10.387938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:10.388415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:10.388517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:10.392784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc4b65924af4e2f839e92d74e26e43f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:10.393514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc4b65924af4e2f839e92d74e26e43f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:10.417158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] MFA Rules not processed for user `65b7373b2c664dc4a054b8943d1d231c`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:10.418637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.420469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 897/1753] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:10 2022] DELETE /identity/v3/users/dfc4b65924af4e2f839e92d74e26e43f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:10.517686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 857/1754] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:10.525821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:10.525821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.585047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0e9fa-38f3-473e-848b-f331dda1fc85 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:10.594161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6f31a-a002-427d-8458-aa7af1680eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:10.594161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6f31a-a002-427d-8458-aa7af1680eaf service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:10.594161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6f31a-a002-427d-8458-aa7af1680eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:10.594161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6f31a-a002-427d-8458-aa7af1680eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:10.594625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dde6f31a-a002-427d-8458-aa7af1680eaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.663412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6f31a-a002-427d-8458-aa7af1680eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:10.665762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6f31a-a002-427d-8458-aa7af1680eaf service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:10.677246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:10.678695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.706950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 898/1755] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:10.840297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1e9b9-0e6d-4027-83e3-8aa42327e201 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:10.850030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:10.851090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:10.852470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:10.852470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] PATH_INFO: `/v3/projects/36d9c067c7174c4b9f1b1c8ffd1f7131` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:10.853059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d9c067c7174c4b9f1b1c8ffd1f7131)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:10.855022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:11.040804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d9c067c7174c4b9f1b1c8ffd1f7131', 'request_id': 'req-e06ba3c2-e3ed-42a5-9998-8633728870cb'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.050014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d9c067c7174c4b9f1b1c8ffd1f7131', 'request_id': 'req-e06ba3c2-e3ed-42a5-9998-8633728870cb'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.134328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d9c067c7174c4b9f1b1c8ffd1f7131', 'request_id': 'req-e06ba3c2-e3ed-42a5-9998-8633728870cb'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.172565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] The token cache is being invalidate because project 36d9c067c7174c4b9f1b1c8ffd1f7131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:11.172918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.173820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.176481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 858/1756] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:10 2022] DELETE /identity/v3/projects/36d9c067c7174c4b9f1b1c8ffd1f7131 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:11.182597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cecc-6abb-4c2f-8057-9ad21f592997 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.183635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cecc-6abb-4c2f-8057-9ad21f592997 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.183927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cecc-6abb-4c2f-8057-9ad21f592997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.224649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-41b7cecc-6abb-4c2f-8057-9ad21f592997 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:11.225970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-41b7cecc-6abb-4c2f-8057-9ad21f592997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:11.320259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:11.321680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:11.379528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 899/1757] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:11.383815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817021a-3900-4bf0-af49-29d33a94cf6b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.384061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817021a-3900-4bf0-af49-29d33a94cf6b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.384417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817021a-3900-4bf0-af49-29d33a94cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.405551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8817021a-3900-4bf0-af49-29d33a94cf6b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:11.406985 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8817021a-3900-4bf0-af49-29d33a94cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:11.419553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 900/1758] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:11.424554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ba3c2-e3ed-42a5-9998-8633728870cb admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:11.425061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817021a-3900-4bf0-af49-29d33a94cf6b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:11.426025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:11.426936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.427501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.427934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] PATH_INFO: `/v3/projects/b67748bf692f4a61aad8d06b9f279fa2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.429248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67748bf692f4a61aad8d06b9f279fa2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:11.431164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:11.432812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817021a-3900-4bf0-af49-29d33a94cf6b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:11.437751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:11.438423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.439066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.439066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.439915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:11.440225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:11.442144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:11.458192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 901/1759] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:11.459295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:11.475501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eae4be-cfd9-423f-a840-f7a6d289c0da admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:11.481856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:11.481856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.482098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.482249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.483091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:11.486517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:11.614186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67748bf692f4a61aad8d06b9f279fa2', 'request_id': 'req-0e399a09-3b31-4512-a434-fc64a78790dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.620463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67748bf692f4a61aad8d06b9f279fa2', 'request_id': 'req-0e399a09-3b31-4512-a434-fc64a78790dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.758393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 902/1760] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:11 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:11.762856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:11.781676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67748bf692f4a61aad8d06b9f279fa2', 'request_id': 'req-0e399a09-3b31-4512-a434-fc64a78790dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.818084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] The token cache is being invalidate because project b67748bf692f4a61aad8d06b9f279fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:11.818408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.821763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0e399a09-3b31-4512-a434-fc64a78790dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:11.829280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 859/1761] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:11 2022] DELETE /identity/v3/projects/b67748bf692f4a61aad8d06b9f279fa2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:11.831085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08b56-fdf6-438d-a1e3-311a0c46cc34 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.831342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08b56-fdf6-438d-a1e3-311a0c46cc34 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.831679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08b56-fdf6-438d-a1e3-311a0c46cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.855838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-eba08b56-fdf6-438d-a1e3-311a0c46cc34 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:11.856987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-eba08b56-fdf6-438d-a1e3-311a0c46cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:11.873151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30974195-6b11-49ed-9e79-0b2b193c28d2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:11.878228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:11.879692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.879692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.879692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.880169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:11.882070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:11.919250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 860/1762] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:11.931134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105bb6-42e6-419c-92a8-660ce07ad6a0 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.931134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105bb6-42e6-419c-92a8-660ce07ad6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.931134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105bb6-42e6-419c-92a8-660ce07ad6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.951241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-40105bb6-42e6-419c-92a8-660ce07ad6a0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:11.952565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-40105bb6-42e6-419c-92a8-660ce07ad6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:11.960995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 861/1763] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:11.965419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40105bb6-42e6-419c-92a8-660ce07ad6a0 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:11.975091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40105bb6-42e6-419c-92a8-660ce07ad6a0 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:11.981119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:11.981869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.982227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.982578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.983378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:11.983786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:11.985597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:11.986106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 903/1764] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:11 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:11.995796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:11.999502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:12.011737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 862/1765] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:12.012683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:12.025247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c0c45-e332-4754-8ecb-cb6487d0f9b9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:12.031213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:12.031500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.032165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.032496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.033199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:12.035168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:12.045429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0f836-7071-4f8f-8f22-56f6fa01f3fd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:12.056710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:12.058627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.060157 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.060644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.062130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:12.064760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:12.083284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 904/1766] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:12.087347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:12.103029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1c98a-d930-4e25-a4ff-15f4e3aafd85 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:12.111889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:12.113108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.113667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.114223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.115763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:12.119209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:12.148322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 905/1767] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:12.152859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:12.165119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e82f1-ac33-4c7f-b396-14552576c12d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:12.174308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f1ff7-01e1-48d7-8104-37512c5a187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:12.175521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f1ff7-01e1-48d7-8104-37512c5a187a admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.175521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f1ff7-01e1-48d7-8104-37512c5a187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.175806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f1ff7-01e1-48d7-8104-37512c5a187a admin admin] PATH_INFO: `/v3/projects/027aa8cab62a4e539bd08f4fd2e9ec1b/users/76ad9348c8814a83858c2d72f881f52f/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.193134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f1ff7-01e1-48d7-8104-37512c5a187a admin admin] RBAC: Authorizing `identity:create_grant(project_id=027aa8cab62a4e539bd08f4fd2e9ec1b, user_id=76ad9348c8814a83858c2d72f881f52f, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:12.195945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f1ff7-01e1-48d7-8104-37512c5a187a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:12.305133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 863/1768] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:12 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:12.306933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:12.398927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 906/1769] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:12 2022] PUT /identity/v3/projects/027aa8cab62a4e539bd08f4fd2e9ec1b/users/76ad9348c8814a83858c2d72f881f52f/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:12.412738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934139a-e99f-4314-9242-3c463da66911 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.413097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934139a-e99f-4314-9242-3c463da66911 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.413999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934139a-e99f-4314-9242-3c463da66911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.495261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c934139a-e99f-4314-9242-3c463da66911 None None] MFA Rules not processed for user `76ad9348c8814a83858c2d72f881f52f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:12.496674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c934139a-e99f-4314-9242-3c463da66911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:12.577680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad22491-e56a-4e70-bc70-6dd08356b27c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:12.681045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:12.681808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.682434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.682764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.683571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:12.685825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 907/1770] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:12.690258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:12.693005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934139a-e99f-4314-9242-3c463da66911 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:12.757002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934139a-e99f-4314-9242-3c463da66911 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:12.772536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:12.773228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.773517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.773795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.774499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:12.783719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:12.855611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 864/1771] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:12 2022] POST /identity/v3/users => generated 289 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:12.860871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:12.883818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0c64-9fc4-45b7-95f5-b110111f1f1a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:12.902195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:12.902827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:12.903388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:12.903607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:12.912499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:12.913972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 908/1772] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:12 2022] POST /identity/v3/projects => generated 371 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:12.918789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:12.919889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:12.957182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 865/1773] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:12.962918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.002065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12e6a0-5193-4533-b760-a930b63448f1 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.068693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889989a2-05a4-407f-900f-70dbe9b95e3d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.076097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.078359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.083365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.083365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.083365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.084564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.211337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.214297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.215267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.225683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.225683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.226020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 909/1774] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:12 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:13.226155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.226283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.250855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6ed5a-b35b-461a-8ccb-8236deac6a78 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.254505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 866/1775] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:13.257447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.258293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.258685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.258945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.260670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.261944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.264919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.277131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 910/1776] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:13.281315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.299910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5ce3-2196-4e4f-8cec-d594157c1fad admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.300416 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b8bf6-2284-41a4-893d-9f28a37a4c8f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.309001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.309994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.310384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.311799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb9b27-f612-4cd9-b07e-1e25e9122e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.312045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] PATH_INFO: `/v3/projects/88a2c64ff87342d2aa1b9384551c23f6/users/6a88898c428f4ee7a46106e75e5d82c4/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.312720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9b27-f612-4cd9-b07e-1e25e9122e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.313004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9b27-f612-4cd9-b07e-1e25e9122e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.315221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9b27-f612-4cd9-b07e-1e25e9122e01 admin admin] PATH_INFO: `/v3/projects/12235c11293647148cb1fc60c386468e/users/31d182ab83814e8d8ff96e3548a2cb1b/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.347110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb9b27-f612-4cd9-b07e-1e25e9122e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12235c11293647148cb1fc60c386468e, user_id=31d182ab83814e8d8ff96e3548a2cb1b, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.353467 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb9b27-f612-4cd9-b07e-1e25e9122e01 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.371184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a2c64ff87342d2aa1b9384551c23f6, user_id=6a88898c428f4ee7a46106e75e5d82c4, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.377261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.557866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 867/1777] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:13 2022] PUT /identity/v3/projects/12235c11293647148cb1fc60c386468e/users/31d182ab83814e8d8ff96e3548a2cb1b/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:13.570563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440162-afb9-401e-ac06-73cbe66f691f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.570881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440162-afb9-401e-ac06-73cbe66f691f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.571191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440162-afb9-401e-ac06-73cbe66f691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.598679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-d3440162-afb9-401e-ac06-73cbe66f691f None None] MFA Rules not processed for user `31d182ab83814e8d8ff96e3548a2cb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:13.610108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 911/1778] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:13 2022] PUT /identity/v3/projects/88a2c64ff87342d2aa1b9384551c23f6/users/6a88898c428f4ee7a46106e75e5d82c4/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:13.613468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d3440162-afb9-401e-ac06-73cbe66f691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:13.617786 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.710233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede05b67-fd61-415e-83dd-a7d8a0b2a30e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.717704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.718606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.718895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.720073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.720859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.727879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.776059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 868/1779] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:13.782476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3440162-afb9-401e-ac06-73cbe66f691f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.791355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 912/1780] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:13.796286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.807684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3440162-afb9-401e-ac06-73cbe66f691f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.827087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.828375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.828839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f0e5-9dea-426c-8d06-2b30b3bb4448 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.828982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.829469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.836797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.844602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.845049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eec350-5577-4b58-968d-972801b21bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.846570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eec350-5577-4b58-968d-972801b21bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.846570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eec350-5577-4b58-968d-972801b21bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.846570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eec350-5577-4b58-968d-972801b21bb5 admin admin] PATH_INFO: `/v3/projects/88a2c64ff87342d2aa1b9384551c23f6/users/6a88898c428f4ee7a46106e75e5d82c4/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.852101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eec350-5577-4b58-968d-972801b21bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a2c64ff87342d2aa1b9384551c23f6, user_id=6a88898c428f4ee7a46106e75e5d82c4, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.855491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eec350-5577-4b58-968d-972801b21bb5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.884469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 913/1781] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:13 2022] PUT /identity/v3/projects/88a2c64ff87342d2aa1b9384551c23f6/users/6a88898c428f4ee7a46106e75e5d82c4/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:13.902503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.902797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.903081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.948794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] MFA Rules not processed for user `6a88898c428f4ee7a46106e75e5d82c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:13.950119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:13.985895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 869/1782] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:13 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:13.987021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:14.100852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d368-d748-4249-8da3-bc75923163ca admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:14.108507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:14.109577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:14.110703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:14.111241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:14.112254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:14.114604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 914/1783] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:14.116429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:14.144136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:14.145586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:14.245807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 870/1784] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:13 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:14.245807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:14.269535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a39509-51c9-4dd5-8cbb-b1793cb3f2dc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:14.272867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b1233-4f9d-4e21-9f8d-0e8b45addd9d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:14.292140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:14.292827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:14.297804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:14.297804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:14.297804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:14.297804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:14.332827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 871/1785] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:14.334006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:14.362704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0abd1-2407-4dc0-b7f9-3b6855da556a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:14.366544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a7915-f307-459a-8a22-c3c01d4a13b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:14.367295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a7915-f307-459a-8a22-c3c01d4a13b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:14.367952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:14.368260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a7915-f307-459a-8a22-c3c01d4a13b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:14.368630 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:14.368760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a7915-f307-459a-8a22-c3c01d4a13b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:14.368918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:14.369200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:14.370478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:14.375141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:14.400838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 872/1786] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:14.415859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:14.430633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8234-f5f3-4ef6-aec1-88e7a10cdef1 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:14.443049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:14.444337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:14.444758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:14.445860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] PATH_INFO: `/v3/projects/915f7908a2954ce583bb5a628411b044/users/3f8d241a51554adfb2ba6142656ff121/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:14.462578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a7915-f307-459a-8a22-c3c01d4a13b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:14.466974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a7915-f307-459a-8a22-c3c01d4a13b9 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:14.482162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=915f7908a2954ce583bb5a628411b044, user_id=3f8d241a51554adfb2ba6142656ff121, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:14.490199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:14.495909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 915/1787] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:14.617829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729e823-cb02-476c-a263-473ffcd1da50 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:14.618778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729e823-cb02-476c-a263-473ffcd1da50 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:14.620660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729e823-cb02-476c-a263-473ffcd1da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:14.622501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 873/1788] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:14 2022] PUT /identity/v3/projects/915f7908a2954ce583bb5a628411b044/users/3f8d241a51554adfb2ba6142656ff121/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:14.657792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b729e823-cb02-476c-a263-473ffcd1da50 None None] MFA Rules not processed for user `3f8d241a51554adfb2ba6142656ff121`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:14.659278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b729e823-cb02-476c-a263-473ffcd1da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:14.769680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:14.772214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 916/1789] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:14.925832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52788e56-50d4-4907-b488-5be8f62ca84c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:14.935193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f663a-d317-4cef-bba3-d13d56ebcf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:14.936126 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f663a-d317-4cef-bba3-d13d56ebcf48 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:14.936423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f663a-d317-4cef-bba3-d13d56ebcf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:14.936708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f663a-d317-4cef-bba3-d13d56ebcf48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:14.937528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f663a-d317-4cef-bba3-d13d56ebcf48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:14.941246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f663a-d317-4cef-bba3-d13d56ebcf48 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.125613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502583d-35d4-43d7-b6f7-ca959122a5b8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.126140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502583d-35d4-43d7-b6f7-ca959122a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.126622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502583d-35d4-43d7-b6f7-ca959122a5b8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.129128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 917/1790] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:15.141896 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 874/1791] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:14 2022] POST /identity/v3/projects => generated 377 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:15.142629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502583d-35d4-43d7-b6f7-ca959122a5b8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:15.181428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586342eb-afed-44ab-9b9d-626f7e9d7f6f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.182894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586342eb-afed-44ab-9b9d-626f7e9d7f6f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.183090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586342eb-afed-44ab-9b9d-626f7e9d7f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.287142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-586342eb-afed-44ab-9b9d-626f7e9d7f6f None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:15.297168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502583d-35d4-43d7-b6f7-ca959122a5b8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:15.298334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-586342eb-afed-44ab-9b9d-626f7e9d7f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:15.328570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:15.329270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.329545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.329825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.330524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:15.332509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.468268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 918/1792] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:15 2022] POST /identity/v3/users => generated 295 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:15.469338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:15.499502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887337b-99d8-4dd4-9442-12b5351b3943 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:15.503280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 875/1793] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:15.530372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:15.530500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.530860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.531065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.531807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:15.533525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.565766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 919/1794] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:15.567513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586342eb-afed-44ab-9b9d-626f7e9d7f6f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:15.582132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586342eb-afed-44ab-9b9d-626f7e9d7f6f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:15.595750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:15.596665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.596973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.597231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] PATH_INFO: `/v3/projects/983001b04bf94036ae523d5a07e23630/users/89ae2d41b70043c2aca1e3cb779b396d/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.617361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:15.620373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:15.643053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983001b04bf94036ae523d5a07e23630, user_id=89ae2d41b70043c2aca1e3cb779b396d, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:15.647781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15508-2637-45e3-a720-5ce3e1d8c269 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:15.650955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.665105 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:15.667047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.667544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.667878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.677867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:15.679798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.699971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 920/1795] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:15.701115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:15.703189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:15.724898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd628e-e129-4841-bb62-d65e1827b223 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:15.730910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:15.732162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.732662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.733013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] PATH_INFO: `/v3/users/fee0b2cc638141b885a940b2b279672f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.735189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee0b2cc638141b885a940b2b279672f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:15.745461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.754151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 876/1796] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:15 2022] PUT /identity/v3/projects/983001b04bf94036ae523d5a07e23630/users/89ae2d41b70043c2aca1e3cb779b396d/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:15.761657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:15.912093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858166e7-91d3-48ff-b320-9bf2902782d3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:15.917880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:15.919110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.919529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.919767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.920510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:15.922798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.936131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 877/1797] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:15.940792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:15.955033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fdb3a-85dd-4651-a85d-4ef65595f3bb admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:15.962317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e46467-41b5-4da5-a619-f70cc874d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:15.964412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e46467-41b5-4da5-a619-f70cc874d228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:15.965395 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e46467-41b5-4da5-a619-f70cc874d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:15.965858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e46467-41b5-4da5-a619-f70cc874d228 admin admin] PATH_INFO: `/v3/projects/983001b04bf94036ae523d5a07e23630/users/89ae2d41b70043c2aca1e3cb779b396d/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:15.968618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e46467-41b5-4da5-a619-f70cc874d228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983001b04bf94036ae523d5a07e23630, user_id=89ae2d41b70043c2aca1e3cb779b396d, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:15.975721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e46467-41b5-4da5-a619-f70cc874d228 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:15.993403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 878/1798] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:15 2022] PUT /identity/v3/projects/983001b04bf94036ae523d5a07e23630/users/89ae2d41b70043c2aca1e3cb779b396d/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:16.004612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:16.007804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:16.008660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:16.015459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee0b2cc638141b885a940b2b279672f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:16.016537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee0b2cc638141b885a940b2b279672f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:16.107795 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] MFA Rules not processed for user `89ae2d41b70043c2aca1e3cb779b396d`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:16.109450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:16.139222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee0b2cc638141b885a940b2b279672f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:16.157636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee0b2cc638141b885a940b2b279672f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:16.160489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0ace61b9-d487-4af7-a2de-f6f26cf10d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee0b2cc638141b885a940b2b279672f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:16.211715 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 921/1799] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:15 2022] DELETE /identity/v3/users/fee0b2cc638141b885a940b2b279672f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:16.248684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:16.248684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:16.248684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:16.306145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 879/1800] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:16.306145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:16.306145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:16.306399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:16.306399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:16.403847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca6e5-a851-4c76-98b6-372f89813742 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:16.430085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 922/1801] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:16.455158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:16.457954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:16.470474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:16.471146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:16.471532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:16.471884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:16.544221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59828a-51c0-4c7e-9e02-3f6fd1b1a1d9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:16.548483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:16.549312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:16.549697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:16.550059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:16.563177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:16.565588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:16.566448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:16.567218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:16.579133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 880/1802] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:16.585158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 923/1803] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:16.698356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:16.698356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:16.712227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcee51-de46-4538-b1cf-7115c8af5c96 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:16.718455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:16.719520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:16.720190 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:16.720571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] PATH_INFO: `/v3/users/76ad9348c8814a83858c2d72f881f52f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:16.722222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ad9348c8814a83858c2d72f881f52f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:16.724518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:16.762518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:16.775041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d5e7b-af89-4a34-a766-41247211eefa service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:16.796349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e2fad-658f-413f-b32a-c5d052ed3e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:16.797508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2fad-658f-413f-b32a-c5d052ed3e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:16.799377 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2fad-658f-413f-b32a-c5d052ed3e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:16.799816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2fad-658f-413f-b32a-c5d052ed3e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:16.806235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e65e2fad-658f-413f-b32a-c5d052ed3e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:16.905557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e2fad-658f-413f-b32a-c5d052ed3e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:16.908740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e2fad-658f-413f-b32a-c5d052ed3e7d service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:16.921882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 924/1804] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:17.124501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ad9348c8814a83858c2d72f881f52f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:17.129912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ad9348c8814a83858c2d72f881f52f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:17.243507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ad9348c8814a83858c2d72f881f52f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:17.268975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ad9348c8814a83858c2d72f881f52f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:17.271969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5f8abcb7-6b2e-472c-9c4e-f8642d21ca2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ad9348c8814a83858c2d72f881f52f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:17.280062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 881/1805] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:16 2022] DELETE /identity/v3/users/76ad9348c8814a83858c2d72f881f52f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:17.284771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:17.285076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:17.285345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:17.316988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:17.318300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:17.437080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 925/1806] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:17.579586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c69b6d-60f7-4d2c-8b52-5bbfa59c37b3 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:17.579888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c69b6d-60f7-4d2c-8b52-5bbfa59c37b3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:17.580611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c69b6d-60f7-4d2c-8b52-5bbfa59c37b3 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:17.582876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 882/1807] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:17.585772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:17.587458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:17.611286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:17.611610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:17.618848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:17.670363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:17.672109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:17.768054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302df3ec-7512-47cb-9ef0-d0d1aae94af6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:17.785488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:17.789167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:17.790051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:17.791932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:17.871433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:17.883087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:17.913162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 883/1808] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:17.929112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 926/1809] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:18.039848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:18.042191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:18.058604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a0594-751b-4018-8ff5-ec881e251129 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:18.066525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:18.067434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:18.068095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:18.068516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:18.083226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:18.085092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:18.113588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 884/1810] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:18.382338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:18.382953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:18.432619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0c85-a5bc-49d8-952e-be2e11d3991a service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:18.432619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:18.432619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:18.432619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:18.433855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] PATH_INFO: `/v3/projects/232e69d421ce4403adf078b04b817b56` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:18.433855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232e69d421ce4403adf078b04b817b56)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:18.434237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:18.761881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232e69d421ce4403adf078b04b817b56', 'request_id': 'req-216fe580-b149-4a6c-ba42-964027589547'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:18.771790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232e69d421ce4403adf078b04b817b56', 'request_id': 'req-216fe580-b149-4a6c-ba42-964027589547'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:18.840962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232e69d421ce4403adf078b04b817b56', 'request_id': 'req-216fe580-b149-4a6c-ba42-964027589547'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:18.855714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] The token cache is being invalidate because project 232e69d421ce4403adf078b04b817b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:18.856296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:18.857424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:18.862344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 927/1811] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:18 2022] DELETE /identity/v3/projects/232e69d421ce4403adf078b04b817b56 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:18.864124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:18.879699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17c732-14aa-4387-be10-3177a6c53bc3 service nova] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:18.977501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:18.980177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:18.980706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:18.981470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] PATH_INFO: `/v3/users/6153666441504d689af1dc3f1431f344` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:18.983112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6153666441504d689af1dc3f1431f344)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:18.986568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:19.172195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:19.174694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:19.203373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fe580-b149-4a6c-ba42-964027589547 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:19.210456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:19.211360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:19.211708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:19.211989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] PATH_INFO: `/v3/projects/027aa8cab62a4e539bd08f4fd2e9ec1b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:19.213743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027aa8cab62a4e539bd08f4fd2e9ec1b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:19.215771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:19.257319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6153666441504d689af1dc3f1431f344'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.270492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6153666441504d689af1dc3f1431f344'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.339422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027aa8cab62a4e539bd08f4fd2e9ec1b', 'request_id': 'req-adf49d0e-857d-46ce-a6ba-f162529fc4b8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.346905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027aa8cab62a4e539bd08f4fd2e9ec1b', 'request_id': 'req-adf49d0e-857d-46ce-a6ba-f162529fc4b8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.368532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6153666441504d689af1dc3f1431f344'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.389013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6153666441504d689af1dc3f1431f344'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.391144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6153666441504d689af1dc3f1431f344'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.402556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 885/1812] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:18 2022] DELETE /identity/v3/users/6153666441504d689af1dc3f1431f344 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:19.440918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027aa8cab62a4e539bd08f4fd2e9ec1b', 'request_id': 'req-adf49d0e-857d-46ce-a6ba-f162529fc4b8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.456316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] The token cache is being invalidate because project 027aa8cab62a4e539bd08f4fd2e9ec1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:19.456801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.457707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.460519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 928/1813] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:19 2022] DELETE /identity/v3/projects/027aa8cab62a4e539bd08f4fd2e9ec1b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:19.465253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:19.469485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:19.595784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a632-62bd-4bf4-8d26-38c6877144cc admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:19.600481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:19.601360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:19.601644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:19.601923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] PATH_INFO: `/v3/users/6a88898c428f4ee7a46106e75e5d82c4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:19.603122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a88898c428f4ee7a46106e75e5d82c4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:19.605627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:19.843494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a88898c428f4ee7a46106e75e5d82c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.851429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a88898c428f4ee7a46106e75e5d82c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.933729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a88898c428f4ee7a46106e75e5d82c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.947014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a88898c428f4ee7a46106e75e5d82c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.948251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a88898c428f4ee7a46106e75e5d82c4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:19.955932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 886/1814] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:19 2022] DELETE /identity/v3/users/6a88898c428f4ee7a46106e75e5d82c4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:20.397179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:20.401684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:20.496960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49d0e-857d-46ce-a6ba-f162529fc4b8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:20.686877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:20.688226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:20.688710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:20.689166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] PATH_INFO: `/v3/projects/e0a0e7613e214f89be5695b0e77f82db` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:20.690740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a0e7613e214f89be5695b0e77f82db)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:20.695511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:20.844486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:20.846259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:20.868252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512fe95-4f8b-4c62-82ea-b5156a1ec3a1 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:20.902775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a0e7613e214f89be5695b0e77f82db', 'request_id': 'req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:20.912875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a0e7613e214f89be5695b0e77f82db', 'request_id': 'req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:20.971814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:20.972909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:20.973264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:20.973532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] PATH_INFO: `/v3/projects/88a2c64ff87342d2aa1b9384551c23f6` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:20.974785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a2c64ff87342d2aa1b9384551c23f6)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:20.976762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.002542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a0e7613e214f89be5695b0e77f82db', 'request_id': 'req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.019567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] The token cache is being invalidate because project e0a0e7613e214f89be5695b0e77f82db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:21.019866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.020524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3d4ddcb9-5f1b-4802-a0b4-1a3c0959d29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.022084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 929/1815] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:20 2022] DELETE /identity/v3/projects/e0a0e7613e214f89be5695b0e77f82db => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:21.028249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89108fa4-25d7-47d0-8a16-79d04170267d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.028662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89108fa4-25d7-47d0-8a16-79d04170267d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.028993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89108fa4-25d7-47d0-8a16-79d04170267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.084436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-89108fa4-25d7-47d0-8a16-79d04170267d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:21.085757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-89108fa4-25d7-47d0-8a16-79d04170267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:21.101407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 930/1816] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:21.119431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fbaf-1049-46d2-b4f4-f6a330b0c0de None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.121408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fbaf-1049-46d2-b4f4-f6a330b0c0de None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.121408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fbaf-1049-46d2-b4f4-f6a330b0c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.147411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a2c64ff87342d2aa1b9384551c23f6', 'request_id': 'req-4576403d-7841-4d25-915b-796fe49bf2fc'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.174788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6802fbaf-1049-46d2-b4f4-f6a330b0c0de None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:21.177338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6802fbaf-1049-46d2-b4f4-f6a330b0c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:21.178849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a2c64ff87342d2aa1b9384551c23f6', 'request_id': 'req-4576403d-7841-4d25-915b-796fe49bf2fc'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.277242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a2c64ff87342d2aa1b9384551c23f6', 'request_id': 'req-4576403d-7841-4d25-915b-796fe49bf2fc'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.296107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] The token cache is being invalidate because project 88a2c64ff87342d2aa1b9384551c23f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:21.296575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.298266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4576403d-7841-4d25-915b-796fe49bf2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:21.304020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 887/1817] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:20 2022] DELETE /identity/v3/projects/88a2c64ff87342d2aa1b9384551c23f6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:21.308927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267542f-0017-48cb-b75b-83b4c8d2d56a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.309567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267542f-0017-48cb-b75b-83b4c8d2d56a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.309856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267542f-0017-48cb-b75b-83b4c8d2d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.327436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 931/1818] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:21.329678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802fbaf-1049-46d2-b4f4-f6a330b0c0de None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.332986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-5267542f-0017-48cb-b75b-83b4c8d2d56a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:21.334508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5267542f-0017-48cb-b75b-83b4c8d2d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:21.342554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802fbaf-1049-46d2-b4f4-f6a330b0c0de None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.346412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 888/1819] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:21.354325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.354695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e684-e10d-40ab-92eb-52567cb88b3f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.354985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e684-e10d-40ab-92eb-52567cb88b3f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.355110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.355264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e684-e10d-40ab-92eb-52567cb88b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.355356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.355678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.356407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:21.356718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.358667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.388760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6428e684-e10d-40ab-92eb-52567cb88b3f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:21.390243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6428e684-e10d-40ab-92eb-52567cb88b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:21.391555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 932/1820] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:21.396689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.407991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 889/1821] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:21.408294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b505-c916-4875-9520-1aedcc584be4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.424251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.424251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.424251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.424251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.425397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.425397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.427448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428e684-e10d-40ab-92eb-52567cb88b3f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.441156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428e684-e10d-40ab-92eb-52567cb88b3f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.442100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.442760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.443041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.443316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.444071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:21.444375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.446182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.459002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 890/1822] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:21.464074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.476172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3537b-d6f8-4595-a24b-3f51f63cd618 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.480424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.481256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.481580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.481996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.482965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.484895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.506528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 933/1823] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:21.511394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.585352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd738ad-b78f-4045-bf44-3e2d44fd32e3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.591902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.592614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.592921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.593170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.593860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.596112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.611656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 891/1824] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:21.615958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.695777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bd504-92cc-4b81-90a2-ba7d74004365 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.705967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.706669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.706959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.708043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.708043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.709930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.725350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 934/1825] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:21.729617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.740850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adbb1f-b793-4b8c-91aa-d442132309b2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.748806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.751625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.751625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.751625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.751625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.752486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.763523 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 935/1826] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:21.767548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.777585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179bb1a-7950-4617-b347-3197a6af90c8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.782472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.783120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.783403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.783779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.784545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.786122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.796079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 936/1827] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:21.800165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.809986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 892/1828] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:21 2022] POST /identity/v3/users => generated 305 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:21.810430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c538b-6e6f-43c2-958f-91f3c6f94a8f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.811130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.815778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.816668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.816948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.817221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] PATH_INFO: `/v3/projects/4df65bf0b5c74344bea69e58d558159a/users/7af48edea732446ba1fe51429f06df61/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.821421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30972-9605-4b50-b680-d76dbf71e8a9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.830356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.831218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.831538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.831831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.832557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.834215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.835131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df65bf0b5c74344bea69e58d558159a, user_id=7af48edea732446ba1fe51429f06df61, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.837898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.847534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 893/1829] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:21.850432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.860288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd4b2-3dfd-4948-9f57-0c849c5286f0 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.864978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.865630 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.865915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.870707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.870707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.870707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.879725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 894/1830] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:21.880623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:21.884014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:21.897324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399d80c-4107-4243-93a6-2626c8743503 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:21.902008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:21.902862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:21.903149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:21.903423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] PATH_INFO: `/v3/users/31d182ab83814e8d8ff96e3548a2cb1b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:21.904638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d182ab83814e8d8ff96e3548a2cb1b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:21.906901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:21.951630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 937/1831] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:21 2022] PUT /identity/v3/projects/4df65bf0b5c74344bea69e58d558159a/users/7af48edea732446ba1fe51429f06df61/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:21.957514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:22.052122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a69841-89f0-4fa8-b788-61ea608942ec admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:22.061133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf623d-38a8-4d13-b9df-cd05196bfffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:22.062702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf623d-38a8-4d13-b9df-cd05196bfffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.063208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf623d-38a8-4d13-b9df-cd05196bfffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.063886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf623d-38a8-4d13-b9df-cd05196bfffd admin admin] PATH_INFO: `/v3/projects/481db453d18d4c36a0587c6d51c5556d/users/d0fbf8a8735a4c52b3a9637afd48507e/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.090280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d182ab83814e8d8ff96e3548a2cb1b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:22.092360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf623d-38a8-4d13-b9df-cd05196bfffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=481db453d18d4c36a0587c6d51c5556d, user_id=d0fbf8a8735a4c52b3a9637afd48507e, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:22.096788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf623d-38a8-4d13-b9df-cd05196bfffd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:22.107072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d182ab83814e8d8ff96e3548a2cb1b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:22.168019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 938/1832] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:21 2022] PUT /identity/v3/projects/481db453d18d4c36a0587c6d51c5556d/users/d0fbf8a8735a4c52b3a9637afd48507e/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:22.179513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9e89b-37c4-4228-8379-ef0df185d73d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.179801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9e89b-37c4-4228-8379-ef0df185d73d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.180079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9e89b-37c4-4228-8379-ef0df185d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.189503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d182ab83814e8d8ff96e3548a2cb1b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:22.204858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d182ab83814e8d8ff96e3548a2cb1b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:22.205804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73262d2-03f1-4d90-887f-a6f3940e5673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d182ab83814e8d8ff96e3548a2cb1b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:22.212403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 895/1833] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:21 2022] DELETE /identity/v3/users/31d182ab83814e8d8ff96e3548a2cb1b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:22.218142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.218142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.218142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.224017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5ac9e89b-37c4-4228-8379-ef0df185d73d None None] MFA Rules not processed for user `7af48edea732446ba1fe51429f06df61`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:22.225388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5ac9e89b-37c4-4228-8379-ef0df185d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:22.250649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] MFA Rules not processed for user `d0fbf8a8735a4c52b3a9637afd48507e`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:22.252048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:22.320164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 939/1834] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:22.321685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.322696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.322696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.337100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 896/1835] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:22.338629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:22.341856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:22.347955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:22.349154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:22.489674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 940/1836] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:22.490612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:22.491999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:22.509400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d979449-16fc-4e0c-9ae5-914deec08358 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:22.518732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:22.522310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.522802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.531088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.531088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:22.531088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:22.531366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3202b-7d60-45d5-baa9-f73f35058ba8 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:22.536514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:22.537309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.537692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.538127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.539076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:22.542300 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:22.629434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 941/1837] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:22 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:22.634191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:22.642372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:22.681384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 897/1838] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:22 2022] POST /identity/v3/projects => generated 363 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:22.681384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:22.741705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94971-311c-49b6-a621-55188b88d2a9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:22.839293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa9ee1-a492-42e7-829e-48e5fa177e13 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:22.845833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:22.846014 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:22.846865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.847151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.847708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.848175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.848574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.849683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.850012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:22.856360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:22.868767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:22.870927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:22.884529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 942/1839] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:22.897050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:22.908018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef71b8d-0dbf-48b4-9af6-34df8d6f1a22 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:22.913566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:22.914429 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:22.914777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:22.915218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:22.916101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:22.918380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:22.981890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 898/1840] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:22 2022] POST /identity/v3/users => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:22.987128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.014655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 943/1841] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:22 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:23.018527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.023363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e3b9f-40a2-4689-8448-7537a5409b43 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.033255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8cdb-f347-4719-a49a-3d887a0883b9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.037859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.040345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.040345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.040345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.041843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.044231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.046046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.046326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.046611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.047022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.049032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.050750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.069709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 899/1842] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:23.078427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.083211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 944/1843] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:23.084663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.099650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3fed8-61ee-4a27-a330-d742f5003836 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.110338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.111947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.112437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.112873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] PATH_INFO: `/v3/projects/8e03eedc1ad4436eb706ef2804766165/users/6e4af14b23664c01ac2db8ac21b66621/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.121581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dfce9-5f94-465f-ae87-3610fe76c956 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.131319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.133906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.134638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.134886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] PATH_INFO: `/v3/projects/53913123c80747feae1122c733d0d59c/users/f985610bf9bf4a21978e4eb639ae726a/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.137752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e03eedc1ad4436eb706ef2804766165, user_id=6e4af14b23664c01ac2db8ac21b66621, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.157652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53913123c80747feae1122c733d0d59c, user_id=f985610bf9bf4a21978e4eb639ae726a, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.161257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.169601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.339191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 945/1845] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:23 2022] PUT /identity/v3/projects/53913123c80747feae1122c733d0d59c/users/f985610bf9bf4a21978e4eb639ae726a/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:23.339191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.339976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 900/1845] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:23 2022] PUT /identity/v3/projects/8e03eedc1ad4436eb706ef2804766165/users/6e4af14b23664c01ac2db8ac21b66621/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:23.341421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.434384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a2c7-b9da-4a6e-8c08-19575c09985c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.440440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.441498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.442182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.442706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.443693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.444246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859af8c6-b53a-4267-be81-1a1569e8b139 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.446626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.453533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.454294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.454944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.454944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.456547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.457982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.462322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 901/1846] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:23.466917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.471814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 946/1847] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:23.475888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.483462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea0ab-b0d9-4f56-b3c2-a528c5d6e017 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.488921 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.492882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.492882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.492882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] PATH_INFO: `/v3/projects/53913123c80747feae1122c733d0d59c/users/f985610bf9bf4a21978e4eb639ae726a/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.493295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaeca3-a180-44eb-abbb-8df36307ba20 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.493725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53913123c80747feae1122c733d0d59c, user_id=f985610bf9bf4a21978e4eb639ae726a, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.497890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.498391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a6e20-f529-4b07-b096-4a9932a1d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.499369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a6e20-f529-4b07-b096-4a9932a1d894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.499925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a6e20-f529-4b07-b096-4a9932a1d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.500371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a6e20-f529-4b07-b096-4a9932a1d894 admin admin] PATH_INFO: `/v3/projects/8e03eedc1ad4436eb706ef2804766165/users/6e4af14b23664c01ac2db8ac21b66621/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.504611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a6e20-f529-4b07-b096-4a9932a1d894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e03eedc1ad4436eb706ef2804766165, user_id=6e4af14b23664c01ac2db8ac21b66621, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.509764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a6e20-f529-4b07-b096-4a9932a1d894 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.515170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 902/1848] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:23 2022] PUT /identity/v3/projects/53913123c80747feae1122c733d0d59c/users/f985610bf9bf4a21978e4eb639ae726a/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:23.542842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.542842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:23.555129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 947/1849] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:23 2022] PUT /identity/v3/projects/8e03eedc1ad4436eb706ef2804766165/users/6e4af14b23664c01ac2db8ac21b66621/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:23.558196 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28224eb-0eb6-4ee7-ad52-5c6af7173736 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.560680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28224eb-0eb6-4ee7-ad52-5c6af7173736 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.561074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28224eb-0eb6-4ee7-ad52-5c6af7173736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.637109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b28224eb-0eb6-4ee7-ad52-5c6af7173736 None None] MFA Rules not processed for user `f985610bf9bf4a21978e4eb639ae726a`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:23.638376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b28224eb-0eb6-4ee7-ad52-5c6af7173736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:23.679398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860355dd-336f-46cc-9a27-221d53d6af94 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.769786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:23.770704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.770992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.771274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] PATH_INFO: `/v3/projects/12235c11293647148cb1fc60c386468e` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.772792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12235c11293647148cb1fc60c386468e)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:23.774731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:23.784156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 948/1850] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:23.785632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:23.785912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:23.786965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:23.824242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] MFA Rules not processed for user `6e4af14b23664c01ac2db8ac21b66621`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:23.825574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:23.905920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12235c11293647148cb1fc60c386468e', 'request_id': 'req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:23.914246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 949/1851] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:23.914246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:23.914246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:23.925286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12235c11293647148cb1fc60c386468e', 'request_id': 'req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:23.977373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372edb-9ceb-4986-b233-b7d1f46f2884 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:23.990575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12235c11293647148cb1fc60c386468e', 'request_id': 'req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.008728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] The token cache is being invalidate because project 12235c11293647148cb1fc60c386468e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:24.009047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.009681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.012368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 903/1852] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:23 2022] DELETE /identity/v3/projects/12235c11293647148cb1fc60c386468e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:24.013046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:24.014399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:24.038378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:24.039077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:24.039339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:24.039653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:24.042086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:24.082956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b6dba-2822-4a14-a64a-f71cd0f67ee8 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:24.089619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:24.090290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:24.090666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:24.090852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:24.092889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:24.129158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:24.130870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:24.153479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 950/1853] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:24.154714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:24.156861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:24.234296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:24.235596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:24.246880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 904/1854] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:24.313618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2338-d2e9-427e-b7ba-7d5dcb2696a0 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:24.326753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:24.328213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:24.328557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:24.328837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] PATH_INFO: `/v3/users/3f8d241a51554adfb2ba6142656ff121` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:24.333462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8d241a51554adfb2ba6142656ff121)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:24.337168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:24.575822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8d241a51554adfb2ba6142656ff121'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.576580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8d241a51554adfb2ba6142656ff121'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.642598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8d241a51554adfb2ba6142656ff121'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.651237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8d241a51554adfb2ba6142656ff121'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.652497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8d241a51554adfb2ba6142656ff121'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:24.674760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 951/1855] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:24 2022] DELETE /identity/v3/users/3f8d241a51554adfb2ba6142656ff121 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:24.863383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:24.872645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678a512-b84e-4507-9e43-c510a611bf0d service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:24.928918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:24.929589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:24.930302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:24.930302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:24.934003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:25.042273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:25.044663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:25.056464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 905/1856] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:25.307830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:25.313416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:25.394687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b0da9-bb61-4583-8165-99c88b8f8541 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:25.400296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:25.402154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:25.402442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:25.402792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] PATH_INFO: `/v3/projects/915f7908a2954ce583bb5a628411b044` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:25.403970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915f7908a2954ce583bb5a628411b044)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:25.406832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:25.548754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915f7908a2954ce583bb5a628411b044', 'request_id': 'req-648afe31-ac00-42d7-b3f3-58b35e108799'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:25.555328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915f7908a2954ce583bb5a628411b044', 'request_id': 'req-648afe31-ac00-42d7-b3f3-58b35e108799'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:25.642297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915f7908a2954ce583bb5a628411b044', 'request_id': 'req-648afe31-ac00-42d7-b3f3-58b35e108799'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:25.657443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] The token cache is being invalidate because project 915f7908a2954ce583bb5a628411b044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:25.657739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:25.658419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:25.660240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 952/1857] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:25 2022] DELETE /identity/v3/projects/915f7908a2954ce583bb5a628411b044 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:25.664180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:25.675538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916774c-f1e9-4911-8f3d-ddb0147b1749 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:25.748012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:25.748875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:25.754204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:25.754538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] PATH_INFO: `/v3/users/89ae2d41b70043c2aca1e3cb779b396d` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:25.755961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ae2d41b70043c2aca1e3cb779b396d)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:25.764083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:25.989629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ae2d41b70043c2aca1e3cb779b396d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.000005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ae2d41b70043c2aca1e3cb779b396d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.112053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ae2d41b70043c2aca1e3cb779b396d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.128783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ae2d41b70043c2aca1e3cb779b396d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.131022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ae2d41b70043c2aca1e3cb779b396d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.146247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 906/1858] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:25 2022] DELETE /identity/v3/users/89ae2d41b70043c2aca1e3cb779b396d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:26.557997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:26.559560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:26.572292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648afe31-ac00-42d7-b3f3-58b35e108799 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:26.624554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:26.626204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:26.633199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:26.635844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:26.636182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:26.636519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] PATH_INFO: `/v3/users/7af48edea732446ba1fe51429f06df61` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:26.637815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af48edea732446ba1fe51429f06df61)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:26.639908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:26.720274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8157e-e94c-4e94-aa9a-a7e0f9b611be admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:26.724957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:26.725858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:26.726144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:26.726523 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] PATH_INFO: `/v3/projects/983001b04bf94036ae523d5a07e23630` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:26.727765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983001b04bf94036ae523d5a07e23630)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:26.730239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:26.966022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af48edea732446ba1fe51429f06df61'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.966802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983001b04bf94036ae523d5a07e23630', 'request_id': 'req-90b44093-43da-448f-a2f6-211d092ae795'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.966967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af48edea732446ba1fe51429f06df61'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:26.973864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983001b04bf94036ae523d5a07e23630', 'request_id': 'req-90b44093-43da-448f-a2f6-211d092ae795'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:27.019489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af48edea732446ba1fe51429f06df61'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:27.028007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af48edea732446ba1fe51429f06df61'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:27.028731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0407ebed-42dd-4dd7-af30-e697b916d4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af48edea732446ba1fe51429f06df61'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:27.050800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 953/1859] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:26 2022] DELETE /identity/v3/users/7af48edea732446ba1fe51429f06df61 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:27.055161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.055501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.055853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.074766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:27.076159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:27.078854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983001b04bf94036ae523d5a07e23630', 'request_id': 'req-90b44093-43da-448f-a2f6-211d092ae795'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:27.098357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] The token cache is being invalidate because project 983001b04bf94036ae523d5a07e23630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:27.100030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:27.102220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-90b44093-43da-448f-a2f6-211d092ae795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:27.107651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 907/1860] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:26 2022] DELETE /identity/v3/projects/983001b04bf94036ae523d5a07e23630 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:27.124090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df91b2-a517-4fc9-b993-7d0bfe78d1f5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.124919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df91b2-a517-4fc9-b993-7d0bfe78d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.125399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df91b2-a517-4fc9-b993-7d0bfe78d1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.149586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-d3df91b2-a517-4fc9-b993-7d0bfe78d1f5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:27.152003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d3df91b2-a517-4fc9-b993-7d0bfe78d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:27.152719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 954/1861] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:27.163642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 908/1862] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:27.164634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.166080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:27.173094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cb893-18db-4e12-b0be-0010626bdf32 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.174026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cb893-18db-4e12-b0be-0010626bdf32 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.174570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cb893-18db-4e12-b0be-0010626bdf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.213959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f84cb893-18db-4e12-b0be-0010626bdf32 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:27.217142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f84cb893-18db-4e12-b0be-0010626bdf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:27.230408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 909/1863] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:27.234292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cb893-18db-4e12-b0be-0010626bdf32 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.243884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df2bf6-9e2d-4df9-8a1c-0b611cedd08f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:27.248158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:27.248831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.249111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.249388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.250358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cb893-18db-4e12-b0be-0010626bdf32 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:27.255771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:27.256710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.260895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.260895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.260895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:27.260895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:27.261891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:27.264870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:27.266778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:27.282601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 955/1864] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:27.300721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 910/1865] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:27.306632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.326674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7c7c-b225-492f-a154-5dd0466eae08 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:27.333265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:27.334107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.334407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.334693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.335583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:27.339370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:27.476843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 956/1866] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:27 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:27.482352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.497517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2f38-0d38-48e6-87da-bdaa729f01da admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:27.599313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:27.600583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.601494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.601926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.602796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:27.606467 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:27.745531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 911/1867] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:27 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:27.749062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.767521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed144cd-8425-4a21-b71f-d078208c2f44 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:27.773630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:27.774536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.774968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.775391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.776861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:27.778675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:27.790529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 957/1868] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:27.800514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.817723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6c4d-d5ad-4120-8872-c1342700943e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:27.826012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:27.827508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.828385 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.828671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.829599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:27.847986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:27.865533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 912/1869] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:27.872213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.889214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f26e0-71dd-40f2-b049-1222b194e52b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:27.895431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0ef40-042c-4770-8db1-7b4d2b1633a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:27.896368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0ef40-042c-4770-8db1-7b4d2b1633a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.896909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0ef40-042c-4770-8db1-7b4d2b1633a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.897190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0ef40-042c-4770-8db1-7b4d2b1633a4 admin admin] PATH_INFO: `/v3/projects/39d889ec82f1448d81022d70576f4229/users/c300eabc495c4162a0304b271822b2bb/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:27.914342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0ef40-042c-4770-8db1-7b4d2b1633a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d889ec82f1448d81022d70576f4229, user_id=c300eabc495c4162a0304b271822b2bb, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:27.918129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0ef40-042c-4770-8db1-7b4d2b1633a4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:27.980795 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:27.983866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:27.985135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 958/1870] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:27 2022] PUT /identity/v3/projects/39d889ec82f1448d81022d70576f4229/users/c300eabc495c4162a0304b271822b2bb/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:27.997464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:27.998667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:27.999150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:28.012229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14df467-e28e-413b-942c-a967db1d2788 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:28.063843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] MFA Rules not processed for user `c300eabc495c4162a0304b271822b2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:28.065493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:28.120419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:28.121301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:28.121689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:28.121870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] PATH_INFO: `/v3/projects/4df65bf0b5c74344bea69e58d558159a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:28.123419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df65bf0b5c74344bea69e58d558159a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:28.125546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:28.157287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 959/1871] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:28.177485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:28.178895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:28.235493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356d6f0-12f0-47a7-9215-5744f789567e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:28.239183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:28.239870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:28.240159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:28.240442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:28.249546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:28.251031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:28.260165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 960/1872] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:28.270827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df65bf0b5c74344bea69e58d558159a', 'request_id': 'req-3f3c2a69-536f-48e4-93fa-e1da399c66a9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.277981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df65bf0b5c74344bea69e58d558159a', 'request_id': 'req-3f3c2a69-536f-48e4-93fa-e1da399c66a9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.278606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:28.289207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad1f0-16ae-4741-85ef-92cbd129ba7d service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:28.344602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:28.345651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:28.345934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:28.346213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] PATH_INFO: `/v3/users/c300eabc495c4162a0304b271822b2bb` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:28.347420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c300eabc495c4162a0304b271822b2bb)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:28.348521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df65bf0b5c74344bea69e58d558159a', 'request_id': 'req-3f3c2a69-536f-48e4-93fa-e1da399c66a9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.349379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:28.359923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] The token cache is being invalidate because project 4df65bf0b5c74344bea69e58d558159a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:28.360222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.360905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.362489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 913/1873] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:27 2022] DELETE /identity/v3/projects/4df65bf0b5c74344bea69e58d558159a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:28.366583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:28.369944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:28.380061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c2a69-536f-48e4-93fa-e1da399c66a9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:28.384701 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:28.385602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:28.385905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:28.386174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] PATH_INFO: `/v3/users/f985610bf9bf4a21978e4eb639ae726a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:28.387384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f985610bf9bf4a21978e4eb639ae726a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:28.389366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:28.522663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c300eabc495c4162a0304b271822b2bb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.523346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c300eabc495c4162a0304b271822b2bb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.548608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f985610bf9bf4a21978e4eb639ae726a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.557638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f985610bf9bf4a21978e4eb639ae726a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.606527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c300eabc495c4162a0304b271822b2bb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.614435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c300eabc495c4162a0304b271822b2bb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.616158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb0a75e2-2981-4277-b53a-467d2ffb89a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c300eabc495c4162a0304b271822b2bb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.638405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 961/1874] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:28 2022] DELETE /identity/v3/users/c300eabc495c4162a0304b271822b2bb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:28.643298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:28.643620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:28.643911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:28.668013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:28.669272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:28.672821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f985610bf9bf4a21978e4eb639ae726a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.692927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f985610bf9bf4a21978e4eb639ae726a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.694000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f985610bf9bf4a21978e4eb639ae726a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:28.703723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 914/1875] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:28 2022] DELETE /identity/v3/users/f985610bf9bf4a21978e4eb639ae726a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:28.773558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 962/1876] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:28.785254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:28.791951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:28.852512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdac887-cbb1-493a-b45f-db26906917c5 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:28.856897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:28.857490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:28.857773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:28.858049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:28.920580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:28.922030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:28.932121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 915/1877] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:29.212112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.214068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:29.227375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d7e3-2a0d-46ca-a6db-993eb5db869a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:29.234578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:29.237189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.238443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.239127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] PATH_INFO: `/v3/projects/53913123c80747feae1122c733d0d59c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.242110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53913123c80747feae1122c733d0d59c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:29.246590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:29.390992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53913123c80747feae1122c733d0d59c', 'request_id': 'req-ce5b0104-9cee-4226-9561-c93346250a29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.396995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53913123c80747feae1122c733d0d59c', 'request_id': 'req-ce5b0104-9cee-4226-9561-c93346250a29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.459579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.461321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:29.477299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7c4e8-ea76-4f6a-9376-246225729df4 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:29.477652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53913123c80747feae1122c733d0d59c', 'request_id': 'req-ce5b0104-9cee-4226-9561-c93346250a29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.492072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] The token cache is being invalidate because project 53913123c80747feae1122c733d0d59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:29.492369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.493015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ce5b0104-9cee-4226-9561-c93346250a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.498989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 963/1878] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:29 2022] DELETE /identity/v3/projects/53913123c80747feae1122c733d0d59c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:29.501392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019276ae-6b00-4b79-ad74-9b88f8446856 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.501733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019276ae-6b00-4b79-ad74-9b88f8446856 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.502052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019276ae-6b00-4b79-ad74-9b88f8446856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.521589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-019276ae-6b00-4b79-ad74-9b88f8446856 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:29.522856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-019276ae-6b00-4b79-ad74-9b88f8446856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:29.539672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:29.540538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.540821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.541594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] PATH_INFO: `/v3/projects/39d889ec82f1448d81022d70576f4229` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.542794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d889ec82f1448d81022d70576f4229)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:29.544836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:29.582418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 964/1879] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:29.590080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a6fbc-4bdc-4206-94ef-a8e6e1c77f47 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.590478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a6fbc-4bdc-4206-94ef-a8e6e1c77f47 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.590833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a6fbc-4bdc-4206-94ef-a8e6e1c77f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.612784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d51a6fbc-4bdc-4206-94ef-a8e6e1c77f47 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:29.615520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d51a6fbc-4bdc-4206-94ef-a8e6e1c77f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:29.623570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 965/1880] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:29.627720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a6fbc-4bdc-4206-94ef-a8e6e1c77f47 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.637149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a6fbc-4bdc-4206-94ef-a8e6e1c77f47 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:29.642020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:29.642622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.642904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.643179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.644004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:29.644355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:29.645968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:29.657859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 966/1881] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:29.662051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.672768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d88e0-6e92-4df0-85f2-20bfc6c3c290 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:29.678585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:29.679249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.679568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.679847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.680534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:29.683015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:29.722634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d889ec82f1448d81022d70576f4229', 'request_id': 'req-769d6ca5-d709-4a79-b265-70b62344f076'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.729486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d889ec82f1448d81022d70576f4229', 'request_id': 'req-769d6ca5-d709-4a79-b265-70b62344f076'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.769293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 967/1882] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:29 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:29.773894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.785583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d889ec82f1448d81022d70576f4229', 'request_id': 'req-769d6ca5-d709-4a79-b265-70b62344f076'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.802594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] The token cache is being invalidate because project 39d889ec82f1448d81022d70576f4229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:29.802836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.803592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-769d6ca5-d709-4a79-b265-70b62344f076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:29.813247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 916/1883] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:29 2022] DELETE /identity/v3/projects/39d889ec82f1448d81022d70576f4229 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:29.825262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794843ed-1c25-48e9-a28b-64d08902400b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.825563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794843ed-1c25-48e9-a28b-64d08902400b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.825847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794843ed-1c25-48e9-a28b-64d08902400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.843303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465a9f-897c-4635-8073-a1f7b6d14e3a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:29.849875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:29.850554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.850832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.851110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.851983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:29.854467 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:29.871659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-794843ed-1c25-48e9-a28b-64d08902400b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:29.873021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-794843ed-1c25-48e9-a28b-64d08902400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:29.888569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 917/1884] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:29.891378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc31fa-0271-459d-b48a-2aa09c28f6b8 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.891714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc31fa-0271-459d-b48a-2aa09c28f6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.891999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc31fa-0271-459d-b48a-2aa09c28f6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.923507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a8cc31fa-0271-459d-b48a-2aa09c28f6b8 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:29.924761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a8cc31fa-0271-459d-b48a-2aa09c28f6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:29.936828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 918/1885] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:29.940758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc31fa-0271-459d-b48a-2aa09c28f6b8 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.950915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc31fa-0271-459d-b48a-2aa09c28f6b8 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:29.956185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:29.956958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.957243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.957523 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:29.958265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:29.958635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:29.962671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:29.964139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 968/1886] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:29 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:29.965876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.967736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:29.986745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 919/1887] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:29.987941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:29.992371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb815bd-a04b-4dfe-9d70-9a9380ed3695 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:29.998410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:29.999208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:29.999533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:29.999826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.000576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.001816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292560c6-20da-45ed-a602-4fae7971aa5c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.002271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.010634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.011317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.011645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.011930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.012634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.014941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.015450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 969/1888] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:30.019521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.033733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29be819-529c-4cce-9861-36464c257163 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.038309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.039008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.039292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.039594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.040454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.042636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.054058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 970/1889] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:30.058568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.069473 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3b294-0e2c-4143-bb56-0e73b5d9bb09 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.074752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49636b84-bb16-4ca1-b64f-e858264c9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.075784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636b84-bb16-4ca1-b64f-e858264c9a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.080492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636b84-bb16-4ca1-b64f-e858264c9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.080492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636b84-bb16-4ca1-b64f-e858264c9a5d admin admin] PATH_INFO: `/v3/projects/419f405a527f4f19a8ac9dcbbc4bedc0/users/c43cead3a9534bc58475d74f7fc33ff6/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.092216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49636b84-bb16-4ca1-b64f-e858264c9a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=419f405a527f4f19a8ac9dcbbc4bedc0, user_id=c43cead3a9534bc58475d74f7fc33ff6, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.095117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49636b84-bb16-4ca1-b64f-e858264c9a5d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.108164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 920/1890] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:29 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:30.112023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.180214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b906a-5bf8-41f6-a645-333fd1dd6cf1 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.188381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 971/1891] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:30 2022] PUT /identity/v3/projects/419f405a527f4f19a8ac9dcbbc4bedc0/users/c43cead3a9534bc58475d74f7fc33ff6/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:30.207419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a93b-9804-430b-8a99-125be1ac56de None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.207735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a93b-9804-430b-8a99-125be1ac56de None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.208019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a93b-9804-430b-8a99-125be1ac56de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.235746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-69f1a93b-9804-430b-8a99-125be1ac56de None None] MFA Rules not processed for user `c43cead3a9534bc58475d74f7fc33ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:30.237036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-69f1a93b-9804-430b-8a99-125be1ac56de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:30.247393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.248196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.248488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.248766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.249453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.251423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.304108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 972/1892] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:30.308666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1a93b-9804-430b-8a99-125be1ac56de None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.319248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1a93b-9804-430b-8a99-125be1ac56de None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.324591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.325251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.325539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.325820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.326595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.328539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.378041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 921/1893] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:30 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:30.378988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.389921 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db150cd-e965-4130-9192-5513ede383f8 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.396397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.397135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.397421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.397718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.398517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.405585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.411683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 922/1894] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:30.416212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.426747 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e7e60-ba0a-4583-91b0-bd94bdc8326e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.431961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.434337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.434337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.434512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.435379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.437126 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.452633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 923/1895] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:30.456919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.468356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcc7c6-0df8-43b7-9e71-da526391ff08 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.483288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 973/1896] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:30 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:30.483377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5213fa-e057-4c93-b101-5299e41c4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.483377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5213fa-e057-4c93-b101-5299e41c4631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.483377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5213fa-e057-4c93-b101-5299e41c4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.483377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5213fa-e057-4c93-b101-5299e41c4631 admin admin] PATH_INFO: `/v3/projects/86d37f176a9d496ebac3987f88a160ba/users/f7cff7487ab84a9f8435aa8cf3046c3e/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.483671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.499800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5213fa-e057-4c93-b101-5299e41c4631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d37f176a9d496ebac3987f88a160ba, user_id=f7cff7487ab84a9f8435aa8cf3046c3e, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.502487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5213fa-e057-4c93-b101-5299e41c4631 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.547276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e24f11-fe4b-4089-a583-07906c0a91d2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.558972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.559791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.560119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.560424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.561111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.563062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.627008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 924/1897] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:30 2022] PUT /identity/v3/projects/86d37f176a9d496ebac3987f88a160ba/users/f7cff7487ab84a9f8435aa8cf3046c3e/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:30.638698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.638994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.639281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.667673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] MFA Rules not processed for user `f7cff7487ab84a9f8435aa8cf3046c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:30.668812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:30.735403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 925/1898] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:30.747088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.748498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:30.784423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 974/1899] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:30 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:30.788461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.798349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b3741-98f2-4a02-bc83-4ca07511070f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.807305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27639063-49e9-466e-b640-a65e6fa055bb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.811012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.811639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.811922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.812221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.820750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.822210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.832308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 926/1900] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:30.852327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.855659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.856338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.856619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.856893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.857626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.859215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.863229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d377a-7351-40b6-8f0a-2e66dae4f813 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.867945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.868809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.869096 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.872845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 975/1901] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:30.872983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] PATH_INFO: `/v3/users/f7cff7487ab84a9f8435aa8cf3046c3e` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.872983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cff7487ab84a9f8435aa8cf3046c3e)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.873137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:30.873781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:30.883693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830c50a-7e09-47b1-b6a7-6a9229a1ef95 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:30.888968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:30.889854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:30.890138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:30.890418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] PATH_INFO: `/v3/projects/947e62625ce642428a0cfd022f8bae75/users/cfec6f41a08042d5acc43e29d78c4afc/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:30.906681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947e62625ce642428a0cfd022f8bae75, user_id=cfec6f41a08042d5acc43e29d78c4afc, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:30.909521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:31.064672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 976/1902] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:30 2022] PUT /identity/v3/projects/947e62625ce642428a0cfd022f8bae75/users/cfec6f41a08042d5acc43e29d78c4afc/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:31.068532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:31.114113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cff7487ab84a9f8435aa8cf3046c3e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:31.125239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cff7487ab84a9f8435aa8cf3046c3e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:31.136284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456b43b-6d75-43b3-a842-91fe31586857 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:31.142554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:31.143380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:31.143826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:31.144121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:31.144946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:31.146643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:31.157634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 977/1903] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:31.163490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:31.173882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48701f-ec4b-4d7a-9efe-ea337dfca4e6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:31.178796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e531a4e-9a3d-45af-b98f-55ede5450802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:31.179670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531a4e-9a3d-45af-b98f-55ede5450802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:31.179958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531a4e-9a3d-45af-b98f-55ede5450802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:31.180229 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531a4e-9a3d-45af-b98f-55ede5450802 admin admin] PATH_INFO: `/v3/projects/947e62625ce642428a0cfd022f8bae75/users/cfec6f41a08042d5acc43e29d78c4afc/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:31.182832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e531a4e-9a3d-45af-b98f-55ede5450802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947e62625ce642428a0cfd022f8bae75, user_id=cfec6f41a08042d5acc43e29d78c4afc, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:31.185584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e531a4e-9a3d-45af-b98f-55ede5450802 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:31.197335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 978/1904] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:31 2022] PUT /identity/v3/projects/947e62625ce642428a0cfd022f8bae75/users/cfec6f41a08042d5acc43e29d78c4afc/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:31.208949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:31.209248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:31.209532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:31.230519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cff7487ab84a9f8435aa8cf3046c3e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:31.238310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] MFA Rules not processed for user `cfec6f41a08042d5acc43e29d78c4afc`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:31.239667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:31.250800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cff7487ab84a9f8435aa8cf3046c3e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:31.252090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-37585816-e7ac-4374-8067-2c42bdceec02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cff7487ab84a9f8435aa8cf3046c3e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:31.260457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 927/1905] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:30 2022] DELETE /identity/v3/users/f7cff7487ab84a9f8435aa8cf3046c3e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:31.269945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:31.270578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:31.270872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:31.290070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:31.291890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:31.311657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 979/1906] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:31.325257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:31.327181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:31.358811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 928/1907] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:31.375073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:31.376515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:31.395220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49e8de-597e-44be-bf29-3c7ce6cc4ac2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:31.439275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12d3b6-79cc-4d38-9c19-068be88bb275 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:31.444088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:31.444738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:31.445022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:31.445304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:31.446689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239415ed-2a78-4ed6-b53a-9e72d1db7196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:31.447351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239415ed-2a78-4ed6-b53a-9e72d1db7196 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:31.447675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239415ed-2a78-4ed6-b53a-9e72d1db7196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:31.447989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239415ed-2a78-4ed6-b53a-9e72d1db7196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:31.457947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:31.459394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:31.469822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 929/1908] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:31.546295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239415ed-2a78-4ed6-b53a-9e72d1db7196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:31.548528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239415ed-2a78-4ed6-b53a-9e72d1db7196 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:31.562047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 980/1909] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:31.994163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:31.995919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:32.014811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40362-6af0-4dcc-8bb3-eb67abf91e71 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:32.020036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:32.020906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:32.025308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:32.025308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] PATH_INFO: `/v3/projects/86d37f176a9d496ebac3987f88a160ba` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:32.025308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d37f176a9d496ebac3987f88a160ba)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:32.026357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:32.194263 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d37f176a9d496ebac3987f88a160ba', 'request_id': 'req-2339605f-0bd1-45cb-949c-fb968ba62ab9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:32.201903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d37f176a9d496ebac3987f88a160ba', 'request_id': 'req-2339605f-0bd1-45cb-949c-fb968ba62ab9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:32.331446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d37f176a9d496ebac3987f88a160ba', 'request_id': 'req-2339605f-0bd1-45cb-949c-fb968ba62ab9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:32.342628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] The token cache is being invalidate because project 86d37f176a9d496ebac3987f88a160ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:32.343052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:32.343813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2339605f-0bd1-45cb-949c-fb968ba62ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:32.346069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 930/1910] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:31 2022] DELETE /identity/v3/projects/86d37f176a9d496ebac3987f88a160ba => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:32.351027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4563-00f6-4080-8e6d-9d5dd00c1cdf None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:32.351957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4563-00f6-4080-8e6d-9d5dd00c1cdf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:32.352460 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4563-00f6-4080-8e6d-9d5dd00c1cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:32.372806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-363c4563-00f6-4080-8e6d-9d5dd00c1cdf None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:32.374019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-363c4563-00f6-4080-8e6d-9d5dd00c1cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:32.459839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 981/1911] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:32.470259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8734-d7c9-4abe-ba64-293ffcdc8d8c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:32.484441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8734-d7c9-4abe-ba64-293ffcdc8d8c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:32.484441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8734-d7c9-4abe-ba64-293ffcdc8d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:32.492499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bc7d8734-d7c9-4abe-ba64-293ffcdc8d8c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:32.493724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bc7d8734-d7c9-4abe-ba64-293ffcdc8d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:32.502696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 931/1912] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:32.506958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c4563-00f6-4080-8e6d-9d5dd00c1cdf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:32.517305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c4563-00f6-4080-8e6d-9d5dd00c1cdf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:32.522267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:32.522936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:32.523227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:32.523533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:32.524409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:32.524630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:32.526259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:32.539502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 982/1913] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:32.544209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8734-d7c9-4abe-ba64-293ffcdc8d8c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:32.553443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8734-d7c9-4abe-ba64-293ffcdc8d8c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:32.558803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:32.559453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:32.563187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:32.563187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:32.563187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:32.563187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:32.705726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 932/1914] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:32 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:32.710126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:32.732884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5499-8305-46f1-afbf-e205decc5d6e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:32.830955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:32.831672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:32.831957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:32.832231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:32.832941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:32.834910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:32.959120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 983/1915] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:32 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:32.963279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:32.973861 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45fbcb-3c3d-4e86-b7a6-b692949326ab admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:32.978434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:32.979111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:32.979414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:32.979714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:32.980450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:32.982067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:32.992933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 933/1916] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:32.997754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.008882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73bb99-7fc5-4de7-9425-ce1857f1d5bf admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.014376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9aa0a-3c76-46e9-af3a-254925bea300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.015088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9aa0a-3c76-46e9-af3a-254925bea300 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.015369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9aa0a-3c76-46e9-af3a-254925bea300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.015676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9aa0a-3c76-46e9-af3a-254925bea300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.016457 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9aa0a-3c76-46e9-af3a-254925bea300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.018493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9aa0a-3c76-46e9-af3a-254925bea300 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.029222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 984/1917] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:33.033309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.044016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be735fdb-b206-4026-90ec-2b633489e1e3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.048809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.049857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.050147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.050422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] PATH_INFO: `/v3/projects/12abc2b1ef0d4b6ca7210187ab9794c4/users/9c876f0dc18243e5b19bee88b50b0e0f/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.074553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12abc2b1ef0d4b6ca7210187ab9794c4, user_id=9c876f0dc18243e5b19bee88b50b0e0f, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.077281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.154204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 934/1918] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:33 2022] PUT /identity/v3/projects/12abc2b1ef0d4b6ca7210187ab9794c4/users/9c876f0dc18243e5b19bee88b50b0e0f/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:33.164574 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.165156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.165748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.195035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] MFA Rules not processed for user `9c876f0dc18243e5b19bee88b50b0e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:33.196338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:33.275520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 985/1919] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:33.280158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.348056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28ad88-7fed-4bb1-864f-7676b5f37b63 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.353202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.354396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.354677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.355119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.356057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.357963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.404448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.406277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:33.424306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00a5ae-7fd2-47ea-a96f-ce992f0f7d77 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.430389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.431386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.432618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.433099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] PATH_INFO: `/v3/users/8bcdb8001413481fbe4089ee9449f59c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.434956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcdb8001413481fbe4089ee9449f59c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.437029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.471987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 935/1920] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:33 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:33.475820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.561326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a47019-59ee-44f1-978a-191557579a9d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.566340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.567050 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.567330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.567668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.568364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.570300 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.732907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 936/1921] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:33 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:33.736579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.749361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf919db-97af-475d-87f1-08a892b16939 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.756536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.758159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.758456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.758743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.759547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.761492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.772755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 937/1922] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:33.778405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.788194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612e7-a801-4142-91b1-bc215c52cf2b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.793536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.794197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.794484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.794765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.815207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.815207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.815207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 938/1923] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:33.815764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcdb8001413481fbe4089ee9449f59c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:33.815764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcdb8001413481fbe4089ee9449f59c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:33.819448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:33.830228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc851c8-8751-4977-a925-b69fbed0ce38 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:33.835313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8f599-ef1e-42f5-b7d0-b7d0619118aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:33.837607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f599-ef1e-42f5-b7d0-b7d0619118aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.837607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f599-ef1e-42f5-b7d0-b7d0619118aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.837607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f599-ef1e-42f5-b7d0-b7d0619118aa admin admin] PATH_INFO: `/v3/projects/eba2a373347d4340b782e6b983257913/users/c7e678af62f54ee5951b3be62514e987/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.866149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8f599-ef1e-42f5-b7d0-b7d0619118aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba2a373347d4340b782e6b983257913, user_id=c7e678af62f54ee5951b3be62514e987, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:33.870084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8f599-ef1e-42f5-b7d0-b7d0619118aa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:33.903271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcdb8001413481fbe4089ee9449f59c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:33.912232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcdb8001413481fbe4089ee9449f59c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:33.912975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b45da1ac-91d7-43d5-ae3a-e8552504c99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcdb8001413481fbe4089ee9449f59c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:33.931838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 986/1924] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:33 2022] DELETE /identity/v3/users/8bcdb8001413481fbe4089ee9449f59c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:33.936717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.937004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.937286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.940984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 939/1925] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:33 2022] PUT /identity/v3/projects/eba2a373347d4340b782e6b983257913/users/c7e678af62f54ee5951b3be62514e987/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:33.952441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:33.953260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:33.953742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:33.958694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:33.959998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:33.984248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] MFA Rules not processed for user `c7e678af62f54ee5951b3be62514e987`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:33.986318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:34.037563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 987/1926] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:34.044093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.046395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:34.068536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 940/1927] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:34.073258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.080360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:34.104453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7b392-6099-4d04-91e4-16ab33bd96d7 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.129735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc616e4-fffe-4fe8-a54e-1ca067394e8d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.129735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.130033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.130131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.130131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.130131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.130310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.130310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.130310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.130310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.130310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.134091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.136293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.153638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 988/1928] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:34.249780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 941/1929] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:34 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:34.253964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.266161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5566725-f119-4509-b9c9-b0ef07cdbfd2 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.328748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.329465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.330301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.330301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.330710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.332768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.427236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.439367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 989/1930] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:34 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:34.446950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea21e3e-75c6-4fa7-aa31-728f67ffe89a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.458823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.468393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.468393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.468393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.468393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.468393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.492147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 942/1931] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:34.493530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.505160 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952a2fe-00da-4d94-8ed9-3fcbba060263 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.539352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.544412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.544789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.547878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] PATH_INFO: `/v3/projects/1bbbba92b8eb42a19d7a5f8a012abb1f/users/a5f7d13b583648d8bbaba95918e58799/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.579379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbbba92b8eb42a19d7a5f8a012abb1f, user_id=a5f7d13b583648d8bbaba95918e58799, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.587773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.694112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 990/1932] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:34 2022] PUT /identity/v3/projects/1bbbba92b8eb42a19d7a5f8a012abb1f/users/a5f7d13b583648d8bbaba95918e58799/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:34.703444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.714485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816a805-3912-470b-a133-64f4c1921a1f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.801267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.801267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.801267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.801267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.801593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.802231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.820711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 943/1933] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:34.824261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.839874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:34.840704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c7074-e95b-4f6f-8a37-5aa151cff8cc admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.841963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:34.854853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2790a6-5ad6-4697-ad7a-f7136e94c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.855968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2790a6-5ad6-4697-ad7a-f7136e94c889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.856292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2790a6-5ad6-4697-ad7a-f7136e94c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.856837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2790a6-5ad6-4697-ad7a-f7136e94c889 admin admin] PATH_INFO: `/v3/projects/1bbbba92b8eb42a19d7a5f8a012abb1f/users/a5f7d13b583648d8bbaba95918e58799/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.861443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2790a6-5ad6-4697-ad7a-f7136e94c889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbbba92b8eb42a19d7a5f8a012abb1f, user_id=a5f7d13b583648d8bbaba95918e58799, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.864947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2790a6-5ad6-4697-ad7a-f7136e94c889 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.871049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9b41-f5ac-4517-8bbd-6aa88fe72519 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:34.881318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:34.884381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.886183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.886966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] PATH_INFO: `/v3/projects/e12e4d877fda4a6da7abdb93cedd6438` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.890989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12e4d877fda4a6da7abdb93cedd6438)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:34.895160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:34.896096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 991/1934] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:34 2022] PUT /identity/v3/projects/1bbbba92b8eb42a19d7a5f8a012abb1f/users/a5f7d13b583648d8bbaba95918e58799/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:34.913751 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:34.914009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:34.914339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:34.951031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] MFA Rules not processed for user `a5f7d13b583648d8bbaba95918e58799`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:34.952750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:35.092730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12e4d877fda4a6da7abdb93cedd6438', 'request_id': 'req-48968895-df8d-4575-9a09-d9fbdd09912b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.099342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 992/1935] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:35.111973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12e4d877fda4a6da7abdb93cedd6438', 'request_id': 'req-48968895-df8d-4575-9a09-d9fbdd09912b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.112577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:35.115037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:35.188490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8ad8-1392-4b5d-904d-dbacaa296eaf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:35.200316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12e4d877fda4a6da7abdb93cedd6438', 'request_id': 'req-48968895-df8d-4575-9a09-d9fbdd09912b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.211653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] The token cache is being invalidate because project e12e4d877fda4a6da7abdb93cedd6438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:35.212547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.213318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.215150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 944/1936] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:34 2022] DELETE /identity/v3/projects/e12e4d877fda4a6da7abdb93cedd6438 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:35.219338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:35.221352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:35.240352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:35.241007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:35.241428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:35.241546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:35.243627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:35.316830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:35.318395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:35.329413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 993/1937] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:35.337508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48968895-df8d-4575-9a09-d9fbdd09912b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:35.342525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:35.343492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:35.343803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:35.344082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] PATH_INFO: `/v3/users/cfbca69b78bc4f299e2a75aaa9fa5883` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:35.345785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbca69b78bc4f299e2a75aaa9fa5883)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:35.347740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:35.532035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbca69b78bc4f299e2a75aaa9fa5883'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.538826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbca69b78bc4f299e2a75aaa9fa5883'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.637131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbca69b78bc4f299e2a75aaa9fa5883'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.653305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:35.653305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:35.654161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbca69b78bc4f299e2a75aaa9fa5883'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.655062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-1bf45860-26b9-4e51-b0b1-64ac8a93e950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbca69b78bc4f299e2a75aaa9fa5883'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:35.667284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 945/1938] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:35 2022] DELETE /identity/v3/users/cfbca69b78bc4f299e2a75aaa9fa5883 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:35.683715 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2878b-d095-40d6-8ab9-beb708ead249 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:35.784959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:35.786353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:35.786642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:35.787061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] PATH_INFO: `/v3/users/c43cead3a9534bc58475d74f7fc33ff6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:35.788440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43cead3a9534bc58475d74f7fc33ff6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:35.796349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:36.109832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43cead3a9534bc58475d74f7fc33ff6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.111169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43cead3a9534bc58475d74f7fc33ff6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.179505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43cead3a9534bc58475d74f7fc33ff6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.188024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43cead3a9534bc58475d74f7fc33ff6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.188789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43cead3a9534bc58475d74f7fc33ff6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.226050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 994/1939] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:35 2022] DELETE /identity/v3/users/c43cead3a9534bc58475d74f7fc33ff6 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:36.231323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:36.231669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:36.231924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:36.268560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:36.270157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:36.406515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 946/1940] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:36.439875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:36.439875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:36.446274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:36.448344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:36.461617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813879a-0a4e-451b-938b-e6e91a1e82fb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:36.468252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:36.469151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:36.469435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:36.469969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] PATH_INFO: `/v3/users/d0fbf8a8735a4c52b3a9637afd48507e` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:36.471233 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0fbf8a8735a4c52b3a9637afd48507e)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:36.473236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:36.561052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ef2-13cd-4f8c-b95b-112c2068d151 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:36.569308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:36.570040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:36.570327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:36.571411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:36.599341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:36.602466 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:36.627144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 995/1941] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:36.628422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:36.638114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:36.671652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d3671-341f-4fc7-bb56-793eba182da2 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:36.678133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:36.679292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:36.679794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:36.680187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] PATH_INFO: `/v3/projects/e20d2936f9e44fd795344b4a6752bf60` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:36.681510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20d2936f9e44fd795344b4a6752bf60)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:36.685806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:36.758964 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0fbf8a8735a4c52b3a9637afd48507e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.768563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0fbf8a8735a4c52b3a9637afd48507e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.846677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0fbf8a8735a4c52b3a9637afd48507e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.863931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20d2936f9e44fd795344b4a6752bf60', 'request_id': 'req-23c5fbd5-75bc-4584-a7e6-dded7c27219f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.868142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0fbf8a8735a4c52b3a9637afd48507e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.868957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f9a831bd-b6af-401a-8b36-a3dfd64bcc02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0fbf8a8735a4c52b3a9637afd48507e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.879329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 947/1942] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:36 2022] DELETE /identity/v3/users/d0fbf8a8735a4c52b3a9637afd48507e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:36.881175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:36.881540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:36.882212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:36.889711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20d2936f9e44fd795344b4a6752bf60', 'request_id': 'req-23c5fbd5-75bc-4584-a7e6-dded7c27219f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:36.910941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:36.912360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:36.985496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20d2936f9e44fd795344b4a6752bf60', 'request_id': 'req-23c5fbd5-75bc-4584-a7e6-dded7c27219f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.002722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] The token cache is being invalidate because project e20d2936f9e44fd795344b4a6752bf60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:37.003041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.005135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-23c5fbd5-75bc-4584-a7e6-dded7c27219f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.010883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 996/1943] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:36 2022] DELETE /identity/v3/projects/e20d2936f9e44fd795344b4a6752bf60 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:37.012967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4e6c-ecd4-4ba3-8d1e-a155e8e5228d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.013324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4e6c-ecd4-4ba3-8d1e-a155e8e5228d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.013617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4e6c-ecd4-4ba3-8d1e-a155e8e5228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.035177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-18cd4e6c-ecd4-4ba3-8d1e-a155e8e5228d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:37.036491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-18cd4e6c-ecd4-4ba3-8d1e-a155e8e5228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:37.055732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 997/1944] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:37.055816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 948/1945] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:37.063332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c08c1-c3ed-4750-b7d0-5ad194702aaf None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.063332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c08c1-c3ed-4750-b7d0-5ad194702aaf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.063332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c08c1-c3ed-4750-b7d0-5ad194702aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.065153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.068275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:37.088702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-797c08c1-c3ed-4750-b7d0-5ad194702aaf None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:37.090631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-797c08c1-c3ed-4750-b7d0-5ad194702aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:37.104930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 998/1946] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:37.108346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c08c1-c3ed-4750-b7d0-5ad194702aaf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.131027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c08c1-c3ed-4750-b7d0-5ad194702aaf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.136785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.138083 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.138616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.139070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.140030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:37.140806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.142874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.158760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 999/1947] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:37.162937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b1f7f-d053-47b0-a170-3a318a0e7c49 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.163250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.167627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.168367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.168716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.169070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.180694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.182566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.194876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 949/1948] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:37.203892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61471-9df3-4a78-9df6-3b42d77d80b8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.210908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.211616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.211903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.212182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.212905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.215874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.324096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1000/1949] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:37 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:37.328205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.342302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52493c72-1ff1-4e8b-8b57-226e82455d5c service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.351239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.354539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:37.442885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e5eaa-e238-4900-90c3-037018bc3f7a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.449315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.451666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.452434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.453106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] PATH_INFO: `/v3/projects/419f405a527f4f19a8ac9dcbbc4bedc0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.454867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=419f405a527f4f19a8ac9dcbbc4bedc0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.457920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.458074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.459514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.459514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.459735 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.460267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.462250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.619848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 950/1950] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:37 2022] POST /identity/v3/users => generated 292 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:37.623943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.634754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a381-0622-4609-ad3f-4a80a8b7f953 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.645441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419f405a527f4f19a8ac9dcbbc4bedc0', 'request_id': 'req-6e802011-1f88-4cd6-a222-34e8a54bed5b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.656270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419f405a527f4f19a8ac9dcbbc4bedc0', 'request_id': 'req-6e802011-1f88-4cd6-a222-34e8a54bed5b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.718465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.719201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.719852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.720151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.722540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.724287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.744331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 951/1951] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:37.751998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.754922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419f405a527f4f19a8ac9dcbbc4bedc0', 'request_id': 'req-6e802011-1f88-4cd6-a222-34e8a54bed5b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.768890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] The token cache is being invalidate because project 419f405a527f4f19a8ac9dcbbc4bedc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:37.769392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.770103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:37.772164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1001/1952] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:37 2022] DELETE /identity/v3/projects/419f405a527f4f19a8ac9dcbbc4bedc0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:37.776580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870237e3-ed6b-4d1f-87cf-81571f3a039e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.778469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.779978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:37.789926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.791277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.796926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.797665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.799693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.801503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.817885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802011-1f88-4cd6-a222-34e8a54bed5b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.832113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.833164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.833454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.833742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] PATH_INFO: `/v3/users/cfec6f41a08042d5acc43e29d78c4afc` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.835070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfec6f41a08042d5acc43e29d78c4afc)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.837391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:37.847547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 952/1953] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:37.856535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:37.859227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:37.879487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc68b57-3534-46f1-b65f-f220f7e098df admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:37.885786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:37.886779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:37.887053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:37.887334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] PATH_INFO: `/v3/projects/a6e38c5dd239481abc0af50c159594e1/users/d16707a1b0e74b0fa1288a003b1af2cd/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:37.905482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e38c5dd239481abc0af50c159594e1, user_id=d16707a1b0e74b0fa1288a003b1af2cd, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:37.911103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:38.010542 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 953/1954] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:37 2022] PUT /identity/v3/projects/a6e38c5dd239481abc0af50c159594e1/users/d16707a1b0e74b0fa1288a003b1af2cd/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:38.011431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:38.020975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:38.055905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfec6f41a08042d5acc43e29d78c4afc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.056901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfec6f41a08042d5acc43e29d78c4afc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.096514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de4bee-6758-445e-b3ac-e2796bc259f3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:38.105335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:38.106030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:38.106318 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:38.106599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:38.108725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:38.128378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfec6f41a08042d5acc43e29d78c4afc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.150502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfec6f41a08042d5acc43e29d78c4afc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.150502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8cab24c9-1d1f-4958-9356-4c1822408279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfec6f41a08042d5acc43e29d78c4afc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.188299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1002/1955] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:37 2022] DELETE /identity/v3/users/cfec6f41a08042d5acc43e29d78c4afc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:38.191235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:38.202744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:38.203062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:38.210596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:38.213751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:38.240489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 954/1956] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:38.241728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:38.246576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:38.269359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] MFA Rules not processed for user `d16707a1b0e74b0fa1288a003b1af2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:38.271938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:38.397720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179acb0-d401-4c27-b25f-e686ad9cbdd9 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:38.413096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1003/1957] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:38.418830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:38.421993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:38.537206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:38.538335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:38.539254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:38.539583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] PATH_INFO: `/v3/projects/481db453d18d4c36a0587c6d51c5556d` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:38.541509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=481db453d18d4c36a0587c6d51c5556d)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:38.545469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:38.605185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0ce97-3037-499d-a00d-c26cc9702dca None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:38.612075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:38.613853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:38.614311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:38.614788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:38.615750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:38.617987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:38.734295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481db453d18d4c36a0587c6d51c5556d', 'request_id': 'req-b068a984-ce69-4777-bde0-c1e1584cac0c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.760291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1004/1958] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:38 2022] POST /identity/v3/projects => generated 383 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:38.767006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481db453d18d4c36a0587c6d51c5556d', 'request_id': 'req-b068a984-ce69-4777-bde0-c1e1584cac0c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.767556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:38.864907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481db453d18d4c36a0587c6d51c5556d', 'request_id': 'req-b068a984-ce69-4777-bde0-c1e1584cac0c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.877019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] The token cache is being invalidate because project 481db453d18d4c36a0587c6d51c5556d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:38.877720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.877820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c317-9e41-448e-89e7-fb4a0adffaa9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:38.878344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:38.883159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 955/1959] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:38 2022] DELETE /identity/v3/projects/481db453d18d4c36a0587c6d51c5556d => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:38.883307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:38.883307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:38.883307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:38.884143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:38.884357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:38.885647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:38.886910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:38.887324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:38.964183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068a984-ce69-4777-bde0-c1e1584cac0c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:38.970076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:38.971105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:38.971783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:38.972193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] PATH_INFO: `/v3/users/6e4af14b23664c01ac2db8ac21b66621` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:38.973699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4af14b23664c01ac2db8ac21b66621)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:38.976898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:38.993628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1005/1960] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:38 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:38.995549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:38.998545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:39.018817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a049-dcc5-461a-a63e-6e214fa39d8b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.023940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.024962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.025425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.025834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] PATH_INFO: `/v3/projects/947e62625ce642428a0cfd022f8bae75` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.027228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947e62625ce642428a0cfd022f8bae75)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.029486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.215505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4af14b23664c01ac2db8ac21b66621'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.215851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947e62625ce642428a0cfd022f8bae75', 'request_id': 'req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.223261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4af14b23664c01ac2db8ac21b66621'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.226827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947e62625ce642428a0cfd022f8bae75', 'request_id': 'req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.297479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4af14b23664c01ac2db8ac21b66621'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.310647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4af14b23664c01ac2db8ac21b66621'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.311442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4af14b23664c01ac2db8ac21b66621'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.317746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 956/1961] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:38 2022] DELETE /identity/v3/users/6e4af14b23664c01ac2db8ac21b66621 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:39.318768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.320239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:39.372148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947e62625ce642428a0cfd022f8bae75', 'request_id': 'req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.390398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] The token cache is being invalidate because project 947e62625ce642428a0cfd022f8bae75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:39.391199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.391758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f0aaa7a1-598e-4aee-9fb5-a849ab3a4f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:39.394289 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1006/1962] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:38 2022] DELETE /identity/v3/projects/947e62625ce642428a0cfd022f8bae75 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:39.400295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d0d4-62c6-4867-acc6-e90688a5f398 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.400593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d0d4-62c6-4867-acc6-e90688a5f398 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.404281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d0d4-62c6-4867-acc6-e90688a5f398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.416688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8f8b-5692-4612-ae6f-d92ef11ac22c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.421594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.422293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.422569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.422853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.424237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.425133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-51b7d0d4-62c6-4867-acc6-e90688a5f398 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:39.426335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.427027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-51b7d0d4-62c6-4867-acc6-e90688a5f398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:39.440246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 957/1963] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:39.444638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.447305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1007/1964] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:39.447608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:39.448850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5505536-5e24-4aea-8c7b-4f9ba9936bdb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.449130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5505536-5e24-4aea-8c7b-4f9ba9936bdb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.449420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5505536-5e24-4aea-8c7b-4f9ba9936bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.465796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278163d-ab4f-45b3-97de-736c1c8d17a3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.473481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e5505536-5e24-4aea-8c7b-4f9ba9936bdb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:39.473748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.474658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.474769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e5505536-5e24-4aea-8c7b-4f9ba9936bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:39.474949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.475224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] PATH_INFO: `/v3/projects/aba62ef466e8497782b0e3cf1bcb8f62/users/c8b9bdff5a164b05acdc8677a2a83df8/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.490530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1008/1965] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:39.492787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba62ef466e8497782b0e3cf1bcb8f62, user_id=c8b9bdff5a164b05acdc8677a2a83df8, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.495389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5505536-5e24-4aea-8c7b-4f9ba9936bdb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.496394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.511681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5505536-5e24-4aea-8c7b-4f9ba9936bdb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.517864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.518702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.518994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.519280 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.520047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:39.520370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.522048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.536813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1009/1966] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:39.541756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.555345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e05d-bbaf-46c4-9262-7da1ab9fa44f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.563774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.564015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.564227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.564561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.565350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.568008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.641456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 958/1967] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:39 2022] PUT /identity/v3/projects/aba62ef466e8497782b0e3cf1bcb8f62/users/c8b9bdff5a164b05acdc8677a2a83df8/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:39.643079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.712332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f572d42-4cef-4858-9e6a-a9ad7c2edfc5 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.720681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.721966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.722441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.722963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.723947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.725766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.736012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1010/1968] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:39 2022] POST /identity/v3/projects => generated 401 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:39.741572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 959/1969] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:39.743138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.743822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.755755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fbbbe-7a8d-43a8-a627-04442c1aaaf3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.821141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdc5dd-ee86-4475-b675-8021a45d42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.821707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc5dd-ee86-4475-b675-8021a45d42e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.822040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc5dd-ee86-4475-b675-8021a45d42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.822985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc5dd-ee86-4475-b675-8021a45d42e1 admin admin] PATH_INFO: `/v3/projects/aba62ef466e8497782b0e3cf1bcb8f62/users/c8b9bdff5a164b05acdc8677a2a83df8/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.825326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdc5dd-ee86-4475-b675-8021a45d42e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba62ef466e8497782b0e3cf1bcb8f62, user_id=c8b9bdff5a164b05acdc8677a2a83df8, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.828352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdc5dd-ee86-4475-b675-8021a45d42e1 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.832428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d09e02-025e-4840-885a-3ded59007754 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:39.838414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:39.842581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.842581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.842581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.842860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 960/1970] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:39 2022] PUT /identity/v3/projects/aba62ef466e8497782b0e3cf1bcb8f62/users/c8b9bdff5a164b05acdc8677a2a83df8/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:39.842953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:39.843995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:39.852475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:39.852766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:39.854938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:39.893876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] MFA Rules not processed for user `c8b9bdff5a164b05acdc8677a2a83df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:39.896074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:39.934260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1011/1971] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:39 2022] POST /identity/v3/users => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:39.938201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:39.956820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feae3d-22cb-4568-8bf4-f142c2c75cda admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:40.051849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 961/1972] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:40.061273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.063328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:40.091640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:40.091640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.094967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.095386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.098729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:40.100555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:40.136622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1012/1973] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:40.137996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.163176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903fcb5-353f-4c8d-bb68-a2ace1a01bc4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:40.170363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:40.171501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.171793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.172078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.172858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:40.184548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:40.205144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1013/1974] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:40.214367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.217508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603319e5-c91c-4825-9cb8-bcef61ca174c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:40.231053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e079e5-195f-46bc-9db3-40d07e58da9a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:40.232230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:40.233351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.233710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.234180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.238687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:40.239840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.240211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.240565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] PATH_INFO: `/v3/projects/4978ac6205434cafb9d570ca71de575b/users/bcc08bce8ef248ceb8f6fc64fd2a8568/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.250605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:40.255793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:40.272830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4978ac6205434cafb9d570ca71de575b, user_id=bcc08bce8ef248ceb8f6fc64fd2a8568, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:40.274678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 962/1975] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:40.278700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:40.284254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.286336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:40.300800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e74ed-3b43-4b75-adaf-4b0896514bcd service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:40.306432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f47159-e20d-403b-b32d-a84d614eb9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:40.308623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f47159-e20d-403b-b32d-a84d614eb9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.311403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f47159-e20d-403b-b32d-a84d614eb9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.311835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f47159-e20d-403b-b32d-a84d614eb9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.316647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-81f47159-e20d-403b-b32d-a84d614eb9d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:40.403047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1014/1976] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:40 2022] PUT /identity/v3/projects/4978ac6205434cafb9d570ca71de575b/users/bcc08bce8ef248ceb8f6fc64fd2a8568/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:40.411746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.427215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f47159-e20d-403b-b32d-a84d614eb9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:40.428812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f47159-e20d-403b-b32d-a84d614eb9d2 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:40.442163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 963/1977] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:40.454492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb442d-d0d7-491e-8f38-c7be8a81a8e8 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.454787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb442d-d0d7-491e-8f38-c7be8a81a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.455068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb442d-d0d7-491e-8f38-c7be8a81a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.509642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fb7ee-196c-4eb3-a091-241b10b98d58 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:40.523669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:40.528120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.528584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.529035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.536478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-fbeb442d-d0d7-491e-8f38-c7be8a81a8e8 None None] MFA Rules not processed for user `bcc08bce8ef248ceb8f6fc64fd2a8568`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:40.538128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-fbeb442d-d0d7-491e-8f38-c7be8a81a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:40.544858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:40.635936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:40.637423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:40.650880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1015/1978] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:40.657744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.659837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 964/1979] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:40.772711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2866fc-21f6-40b6-807d-54c3dba37c1c service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:40.788475 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:40.789277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:40.789647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:40.790021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:40.792626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:40.794803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:40.939269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1016/1980] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:40 2022] POST /identity/v3/projects => generated 399 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:40.941673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb442d-d0d7-491e-8f38-c7be8a81a8e8 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.951776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:40.955028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:40.956925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb442d-d0d7-491e-8f38-c7be8a81a8e8 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.052171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.053179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.053801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.054248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.055777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.058241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.066672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79534f2e-357f-48b3-bf9d-8802e17cc61d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.075333 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.076777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.076913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.077152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] PATH_INFO: `/v3/projects/8e03eedc1ad4436eb706ef2804766165` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.079256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e03eedc1ad4436eb706ef2804766165)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.081288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.160157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 965/1981] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:40 2022] POST /identity/v3/users => generated 306 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:41.161766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.172477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae28fc-0ace-49b7-bd90-4e384020864e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.178073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.178844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.179510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.179510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.180180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.196686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.203667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 966/1982] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:41.206347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.252193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b79f-9a51-45a1-9044-8b43275b3568 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.253682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e03eedc1ad4436eb706ef2804766165', 'request_id': 'req-1b3fd831-6da7-4f7d-94c1-20038c94e568'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:41.279152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e03eedc1ad4436eb706ef2804766165', 'request_id': 'req-1b3fd831-6da7-4f7d-94c1-20038c94e568'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:41.343583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e03eedc1ad4436eb706ef2804766165', 'request_id': 'req-1b3fd831-6da7-4f7d-94c1-20038c94e568'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:41.361494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.364504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.365180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.365816 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] PATH_INFO: `/v3/projects/86e7b793c5e3425ea6366fc2957c11d6/users/24238b5832ae49339971690a8bc59b27/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.378020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] The token cache is being invalidate because project 8e03eedc1ad4436eb706ef2804766165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:41.380941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:41.381699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1b3fd831-6da7-4f7d-94c1-20038c94e568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:41.386982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1017/1983] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:40 2022] DELETE /identity/v3/projects/8e03eedc1ad4436eb706ef2804766165 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:41.392046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d2b57-da27-4612-b29c-5a771dcc02e0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.392362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d2b57-da27-4612-b29c-5a771dcc02e0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.392769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d2b57-da27-4612-b29c-5a771dcc02e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.397796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e7b793c5e3425ea6366fc2957c11d6, user_id=24238b5832ae49339971690a8bc59b27, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.401524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.432370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-565d2b57-da27-4612-b29c-5a771dcc02e0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:41.433804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-565d2b57-da27-4612-b29c-5a771dcc02e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:41.458841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1018/1984] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:41.461808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac056-ecb8-4204-897b-f579ced6428c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.462101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac056-ecb8-4204-897b-f579ced6428c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.462383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac056-ecb8-4204-897b-f579ced6428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.502807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e29ac056-ecb8-4204-897b-f579ced6428c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:41.504297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e29ac056-ecb8-4204-897b-f579ced6428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:41.504545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 967/1985] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:41 2022] PUT /identity/v3/projects/86e7b793c5e3425ea6366fc2957c11d6/users/24238b5832ae49339971690a8bc59b27/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:41.509250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.512561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:41.629239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e4dbf-5718-44a3-9beb-7f5c3d0e1598 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.635623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.637490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.637883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.638846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.639193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.641035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.653856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1019/1986] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:41.656339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 968/1987] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:41.659032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac056-ecb8-4204-897b-f579ced6428c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.660148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.671729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac056-ecb8-4204-897b-f579ced6428c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.675649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42bdfb-9e20-4345-a0c5-1e737b2a171e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.677520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121761b0-16a1-4a06-8e1c-bfc3dac2a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.678576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121761b0-16a1-4a06-8e1c-bfc3dac2a4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.678924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121761b0-16a1-4a06-8e1c-bfc3dac2a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.679270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121761b0-16a1-4a06-8e1c-bfc3dac2a4fc admin admin] PATH_INFO: `/v3/projects/86e7b793c5e3425ea6366fc2957c11d6/users/24238b5832ae49339971690a8bc59b27/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.681249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.682185 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121761b0-16a1-4a06-8e1c-bfc3dac2a4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e7b793c5e3425ea6366fc2957c11d6, user_id=24238b5832ae49339971690a8bc59b27, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.682906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.683264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.683650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.684476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:41.684852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.685437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121761b0-16a1-4a06-8e1c-bfc3dac2a4fc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.686663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.698313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1020/1988] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:41 2022] PUT /identity/v3/projects/86e7b793c5e3425ea6366fc2957c11d6/users/24238b5832ae49339971690a8bc59b27/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:41.712279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 969/1989] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:41.717090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.717394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.717716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.720545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.734591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d4b7e-0d68-401e-bedb-489b69542af8 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.762310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] MFA Rules not processed for user `24238b5832ae49339971690a8bc59b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:41.765006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:41.808153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.809317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.809842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.810339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.811686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.817532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:41.865160 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1021/1990] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:41.873384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.877666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:41.946633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b185d-c88f-43b1-96e7-1a5e46a01019 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:41.953606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 970/1991] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:41 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:41.954147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:41.954147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:41.954662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:41.954775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:41.955880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:41.985015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:41.986581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:42.011578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1022/1992] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:42.083954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce378c9-4004-4653-be94-2e9ff05d55aa admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:42.090047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:42.090791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:42.091084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:42.091364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:42.092098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:42.094166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:42.211404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 971/1993] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:41 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:42.215915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:42.231862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db07a9c-1c69-4fe9-8642-cef7d2f20102 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:42.236584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:42.237257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:42.237546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:42.237829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:42.238555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:42.240194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:42.251263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1023/1994] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:42.254990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:42.273414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ee6d-745c-40d3-a010-8a347d2fcaa4 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:42.279343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:42.280150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:42.280602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:42.281106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:42.282193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:42.283691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:42.298180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 972/1995] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:42.299520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:42.313405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1298f-8e2e-4528-83be-8fff692e23d9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:42.319591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c213bf4-74af-4b65-9d43-74797de7a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:42.320799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c213bf4-74af-4b65-9d43-74797de7a275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:42.321344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c213bf4-74af-4b65-9d43-74797de7a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:42.321845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c213bf4-74af-4b65-9d43-74797de7a275 admin admin] PATH_INFO: `/v3/projects/94f2dce393564009b2689b67cc2f34ce/users/c24559a2a560455e9f6e213cb75a02f8/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:42.363795 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:42.366471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c213bf4-74af-4b65-9d43-74797de7a275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f2dce393564009b2689b67cc2f34ce, user_id=c24559a2a560455e9f6e213cb75a02f8, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:42.371291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c213bf4-74af-4b65-9d43-74797de7a275 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:42.428941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28fe3b-30f7-4405-ab6c-2496bd8e8f8b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:42.432819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:42.435745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:42.435745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:42.435745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:42.435972 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:42.466091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1024/1996] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:42 2022] PUT /identity/v3/projects/94f2dce393564009b2689b67cc2f34ce/users/c24559a2a560455e9f6e213cb75a02f8/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:42.466091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:42.466091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:42.466091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:42.494865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:42.496226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:42.521591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:42.523603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:42.534965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 973/1997] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:42.597760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1025/1998] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:42.608360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:42.609895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:42.735113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36df2e-111d-4250-963f-073ad09178a7 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:42.823781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae47c0f-bc8e-49e4-a4c3-c7dbc1354308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:42.824462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47c0f-bc8e-49e4-a4c3-c7dbc1354308 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:42.824730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47c0f-bc8e-49e4-a4c3-c7dbc1354308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:42.825009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47c0f-bc8e-49e4-a4c3-c7dbc1354308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:42.846256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae47c0f-bc8e-49e4-a4c3-c7dbc1354308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:42.849952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae47c0f-bc8e-49e4-a4c3-c7dbc1354308 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:42.867059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 974/1999] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:44.147780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:44.149265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:44.160999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c65110-6bf6-4166-852c-f28ca18356f3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:44.166394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:44.167300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.167629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.167915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] PATH_INFO: `/v3/users/d16707a1b0e74b0fa1288a003b1af2cd` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.169116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16707a1b0e74b0fa1288a003b1af2cd)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:44.171044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:44.355935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659120ea-a761-499e-af43-b4b569b66f8c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.356606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659120ea-a761-499e-af43-b4b569b66f8c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.356606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659120ea-a761-499e-af43-b4b569b66f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.387912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-659120ea-a761-499e-af43-b4b569b66f8c None None] MFA Rules not processed for user `c24559a2a560455e9f6e213cb75a02f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:44.389150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-659120ea-a761-499e-af43-b4b569b66f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:44.419093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16707a1b0e74b0fa1288a003b1af2cd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:44.420378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16707a1b0e74b0fa1288a003b1af2cd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:44.475996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 975/2000] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:44.480928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659120ea-a761-499e-af43-b4b569b66f8c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:44.491681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659120ea-a761-499e-af43-b4b569b66f8c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:44.496863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:44.497770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.498062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.498340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.499035 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:44.499403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16707a1b0e74b0fa1288a003b1af2cd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:44.501028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:44.507063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16707a1b0e74b0fa1288a003b1af2cd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:44.507832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dd27f024-ad8d-42ea-baa1-978c2cba6d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16707a1b0e74b0fa1288a003b1af2cd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:44.525173 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1026/2001] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:44 2022] DELETE /identity/v3/users/d16707a1b0e74b0fa1288a003b1af2cd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:44.529493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.529780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.530066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.550765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:44.551992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:44.615478 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 976/2002] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:44 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:44.616716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1027/2003] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:44.616716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:44.621284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:44.627040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:44.628836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:44.633385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ecda0-f4ac-4966-9e1a-f9f5373e4fdd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:44.690243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e605eb9-8a05-42e2-97bf-4316674660a2 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:44.694193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:44.694973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.695337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.695650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.696222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:44.696908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.703539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.703539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.703539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:44.703539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:44.712582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:44.714456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:44.729324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 977/2004] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:44.783615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1028/2005] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:44 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:44.787281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:44.799216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69eb5-c9dc-401c-9829-da365841ab46 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:44.805581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:44.807278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.807665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.808282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.809353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:44.810626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:44.825710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 978/2006] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:44.827094 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:44.838314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76314092-b5a9-41df-9975-c21c315f6d3f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:44.843378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:44.844844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:44.845194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:44.845538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] PATH_INFO: `/v3/projects/4bcff1a488e2489b86e052406f711635/users/0af3818e84e044d882d7bab32592f086/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:44.864454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcff1a488e2489b86e052406f711635, user_id=0af3818e84e044d882d7bab32592f086, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:44.867422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:44.948130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1029/2007] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:44 2022] PUT /identity/v3/projects/4bcff1a488e2489b86e052406f711635/users/0af3818e84e044d882d7bab32592f086/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:44.952263 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:44.979103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c783f-9135-45cb-8755-218f5ef11d48 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:45.053873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:45.055058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:45.055755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:45.062045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:45.062045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:45.062045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:45.071778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 979/2008] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:45.075966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:45.090700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d33f1b-6a6e-4a1b-beff-97a7f94eae52 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:45.096732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:45.097853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:45.098136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:45.098584 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] PATH_INFO: `/v3/projects/4bcff1a488e2489b86e052406f711635/users/0af3818e84e044d882d7bab32592f086/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:45.100843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcff1a488e2489b86e052406f711635, user_id=0af3818e84e044d882d7bab32592f086, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:45.104363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:45.121629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1030/2009] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:45 2022] PUT /identity/v3/projects/4bcff1a488e2489b86e052406f711635/users/0af3818e84e044d882d7bab32592f086/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:45.205488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:45.207056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:45.222708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe576f-3bcf-478d-b4a5-fceedf298bc2 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:45.308818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:45.309643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:45.309929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:45.310210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] PATH_INFO: `/v3/projects/a6e38c5dd239481abc0af50c159594e1` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:45.311450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e38c5dd239481abc0af50c159594e1)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:45.313457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:45.433950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e38c5dd239481abc0af50c159594e1', 'request_id': 'req-d629603e-1b03-415a-9c29-70b8c576a83f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.446137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e38c5dd239481abc0af50c159594e1', 'request_id': 'req-d629603e-1b03-415a-9c29-70b8c576a83f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.522301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e38c5dd239481abc0af50c159594e1', 'request_id': 'req-d629603e-1b03-415a-9c29-70b8c576a83f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.535450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] The token cache is being invalidate because project a6e38c5dd239481abc0af50c159594e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:45.535776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.536472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.538097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 980/2010] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:45 2022] DELETE /identity/v3/projects/a6e38c5dd239481abc0af50c159594e1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:45.542473 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:45.544398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:45.559941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8720-eddc-47e7-9401-5ce16351d000 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:45.620295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:45.621220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:45.621504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:45.621782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] PATH_INFO: `/v3/users/c8b9bdff5a164b05acdc8677a2a83df8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:45.623170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b9bdff5a164b05acdc8677a2a83df8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:45.625366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:45.669864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:45.671000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:45.686339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629603e-1b03-415a-9c29-70b8c576a83f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:45.696455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:45.698018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:45.698460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:45.703041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] PATH_INFO: `/v3/users/9c876f0dc18243e5b19bee88b50b0e0f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:45.703041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c876f0dc18243e5b19bee88b50b0e0f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:45.703041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:45.853608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b9bdff5a164b05acdc8677a2a83df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.854650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b9bdff5a164b05acdc8677a2a83df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.919903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c876f0dc18243e5b19bee88b50b0e0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.927355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c876f0dc18243e5b19bee88b50b0e0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.934084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b9bdff5a164b05acdc8677a2a83df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.942437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b9bdff5a164b05acdc8677a2a83df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.943278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b9bdff5a164b05acdc8677a2a83df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:45.965944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1031/2011] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:45 2022] DELETE /identity/v3/users/c8b9bdff5a164b05acdc8677a2a83df8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:45.969687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:45.969687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.000343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c876f0dc18243e5b19bee88b50b0e0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.024473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c876f0dc18243e5b19bee88b50b0e0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.026497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a3847d2e-0ef9-43a9-ba4d-2571714f8be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c876f0dc18243e5b19bee88b50b0e0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.035402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 981/2012] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:45 2022] DELETE /identity/v3/users/9c876f0dc18243e5b19bee88b50b0e0f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:46.040443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:46.041128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:46.041479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:46.051216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f2a12-1165-49a6-96b9-6c8ed6f17e82 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:46.061560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:46.063078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.127395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:46.128406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:46.128742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:46.129077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] PATH_INFO: `/v3/users/7f92a7aeb4664a8db7f67e03cf90c1ef` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:46.130829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f92a7aeb4664a8db7f67e03cf90c1ef)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:46.132964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:46.163212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 982/2013] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:46.174096 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:46.176593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.279272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7548bf-fa95-4582-8302-6a2406d3e6eb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:46.293948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701d20c-c3e4-41eb-a383-93937b06491e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:46.293948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701d20c-c3e4-41eb-a383-93937b06491e service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:46.293948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701d20c-c3e4-41eb-a383-93937b06491e service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:46.293948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701d20c-c3e4-41eb-a383-93937b06491e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:46.305520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701d20c-c3e4-41eb-a383-93937b06491e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:46.307368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701d20c-c3e4-41eb-a383-93937b06491e service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:46.336264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 983/2014] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:46.373241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f92a7aeb4664a8db7f67e03cf90c1ef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.374972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f92a7aeb4664a8db7f67e03cf90c1ef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.445323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f92a7aeb4664a8db7f67e03cf90c1ef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.460684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f92a7aeb4664a8db7f67e03cf90c1ef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.461954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f92a7aeb4664a8db7f67e03cf90c1ef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.485256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1032/2015] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:45 2022] DELETE /identity/v3/users/7f92a7aeb4664a8db7f67e03cf90c1ef => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:46.553439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:46.554039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:46.554039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:46.588842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] MFA Rules not processed for user `0af3818e84e044d882d7bab32592f086`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:46.590438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.598931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:46.603689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.696367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 984/2016] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:46.711391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:46.715342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.766076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5169b9-a7f7-4f47-9d32-336c036304f4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:46.772479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:46.773314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:46.773600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:46.773880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] PATH_INFO: `/v3/projects/aba62ef466e8497782b0e3cf1bcb8f62` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:46.775294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba62ef466e8497782b0e3cf1bcb8f62)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:46.777810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:46.809353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de978f0e-e6f0-4e11-a828-c9b8a10eedd5 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:46.814834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:46.815546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:46.816043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:46.816192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:46.829308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.892705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:46.894175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:46.906589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 985/2017] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:46.907518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:46.909157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:46.924471 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224249d7-7973-4d6d-9776-65878ae93b1c service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:46.932365 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:46.933361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:46.933584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:46.933871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] PATH_INFO: `/v3/projects/d5749714520245aaaf1d3bbfbff50f83` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:46.936054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5749714520245aaaf1d3bbfbff50f83)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:46.938110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:46.957416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba62ef466e8497782b0e3cf1bcb8f62', 'request_id': 'req-4002836f-bd9f-429d-af4c-929d6b04e375'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:46.965599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba62ef466e8497782b0e3cf1bcb8f62', 'request_id': 'req-4002836f-bd9f-429d-af4c-929d6b04e375'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.357272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba62ef466e8497782b0e3cf1bcb8f62', 'request_id': 'req-4002836f-bd9f-429d-af4c-929d6b04e375'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.357272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] The token cache is being invalidate because project aba62ef466e8497782b0e3cf1bcb8f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:47.357272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.357272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4002836f-bd9f-429d-af4c-929d6b04e375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.357272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1033/2018] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:46 2022] DELETE /identity/v3/projects/aba62ef466e8497782b0e3cf1bcb8f62 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:47.358086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5749714520245aaaf1d3bbfbff50f83', 'request_id': 'req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.358086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5749714520245aaaf1d3bbfbff50f83', 'request_id': 'req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.358647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.358647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.358647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.367368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:47.369587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:47.428426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1034/2019] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:47.429452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:47.430689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:47.443355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe1307-e6b6-4beb-8de7-c4c50cb8076c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:47.448929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:47.449786 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.450198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.450485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] PATH_INFO: `/v3/projects/12abc2b1ef0d4b6ca7210187ab9794c4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.451741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12abc2b1ef0d4b6ca7210187ab9794c4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:47.453674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:47.499125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5749714520245aaaf1d3bbfbff50f83', 'request_id': 'req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.582828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] The token cache is being invalidate because project d5749714520245aaaf1d3bbfbff50f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:47.582828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.582828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3b21fb5c-8f2e-49fd-b4d6-30d790d19a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.582828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 986/2020] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:46 2022] DELETE /identity/v3/projects/d5749714520245aaaf1d3bbfbff50f83 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:47.582828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8d43-5b74-4f8d-937a-6821deb6c2c9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.585800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8d43-5b74-4f8d-937a-6821deb6c2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.585800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8d43-5b74-4f8d-937a-6821deb6c2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.585800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4b2e8d43-5b74-4f8d-937a-6821deb6c2c9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:47.585800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4b2e8d43-5b74-4f8d-937a-6821deb6c2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:47.585800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 987/2021] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:47.586695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e8d43-5b74-4f8d-937a-6821deb6c2c9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:47.597666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e8d43-5b74-4f8d-937a-6821deb6c2c9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:47.602868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49db234-8a55-4773-a744-7d89824de7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:47.604051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49db234-8a55-4773-a744-7d89824de7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.604334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49db234-8a55-4773-a744-7d89824de7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.604613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49db234-8a55-4773-a744-7d89824de7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.618480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49db234-8a55-4773-a744-7d89824de7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:47.618480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49db234-8a55-4773-a744-7d89824de7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:47.618480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49db234-8a55-4773-a744-7d89824de7a5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:47.623384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 988/2022] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:47.623384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781698-14de-411a-aa29-c57f7ab76ad9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.623384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781698-14de-411a-aa29-c57f7ab76ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.623384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781698-14de-411a-aa29-c57f7ab76ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.640818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0c781698-14de-411a-aa29-c57f7ab76ad9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:47.655703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0c781698-14de-411a-aa29-c57f7ab76ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:47.655703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 989/2023] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:47.655703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c781698-14de-411a-aa29-c57f7ab76ad9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:47.662347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c781698-14de-411a-aa29-c57f7ab76ad9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:47.667764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0c201-3383-4a60-ac01-37fcbb071d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:47.668432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0c201-3383-4a60-ac01-37fcbb071d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.668896 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0c201-3383-4a60-ac01-37fcbb071d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.669181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0c201-3383-4a60-ac01-37fcbb071d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.669883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0c201-3383-4a60-ac01-37fcbb071d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:47.671807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0c201-3383-4a60-ac01-37fcbb071d1a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:47.845848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12abc2b1ef0d4b6ca7210187ab9794c4', 'request_id': 'req-0e3644ce-22f3-442f-a3e2-67999503dea2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.852346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12abc2b1ef0d4b6ca7210187ab9794c4', 'request_id': 'req-0e3644ce-22f3-442f-a3e2-67999503dea2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.884675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 990/2024] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:47 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:47.886237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfb8f-fbb4-4af8-bc7c-2badc4f10784 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.886686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfb8f-fbb4-4af8-bc7c-2badc4f10784 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.886976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfb8f-fbb4-4af8-bc7c-2badc4f10784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.909680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9aadfb8f-fbb4-4af8-bc7c-2badc4f10784 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:47.911038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9aadfb8f-fbb4-4af8-bc7c-2badc4f10784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:47.962259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12abc2b1ef0d4b6ca7210187ab9794c4', 'request_id': 'req-0e3644ce-22f3-442f-a3e2-67999503dea2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.974688 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] The token cache is being invalidate because project 12abc2b1ef0d4b6ca7210187ab9794c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:47.975223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.975884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:47.976771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 991/2025] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:47.977681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1035/2026] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:47 2022] DELETE /identity/v3/projects/12abc2b1ef0d4b6ca7210187ab9794c4 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:47.977800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadfb8f-fbb4-4af8-bc7c-2badc4f10784 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:47.981609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:47.983122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:47.989029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadfb8f-fbb4-4af8-bc7c-2badc4f10784 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:47.994187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:47.996070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:47.996070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:47.996070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:47.996334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:47.998376 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.051119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3644ce-22f3-442f-a3e2-67999503dea2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.056908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.057573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.057853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.058142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.059007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:48.059288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.060981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.073666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1036/2027] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:48.076290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.076290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:48.089441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ccea9-2ceb-44ac-8c8e-d1f82f45a475 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.094692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.095626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.095910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.096187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] PATH_INFO: `/v3/users/c7e678af62f54ee5951b3be62514e987` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.097393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e678af62f54ee5951b3be62514e987)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.099360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.100428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 992/2028] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:47 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:48.101276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.103023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:48.116428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390690ee-df17-4eb9-9d57-889c592d4744 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.124104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.124104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.124104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.124104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] PATH_INFO: `/v3/users/bcc08bce8ef248ceb8f6fc64fd2a8568` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.124727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc08bce8ef248ceb8f6fc64fd2a8568)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.126061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.314550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e678af62f54ee5951b3be62514e987'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.315339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e678af62f54ee5951b3be62514e987'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.317730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc08bce8ef248ceb8f6fc64fd2a8568'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.326383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc08bce8ef248ceb8f6fc64fd2a8568'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.399385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e678af62f54ee5951b3be62514e987'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.410687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e678af62f54ee5951b3be62514e987'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.411492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e678af62f54ee5951b3be62514e987'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.428939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1037/2029] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:48 2022] DELETE /identity/v3/users/c7e678af62f54ee5951b3be62514e987 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:48.430005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.431161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:48.499742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc08bce8ef248ceb8f6fc64fd2a8568'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.515535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc08bce8ef248ceb8f6fc64fd2a8568'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.516613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc08bce8ef248ceb8f6fc64fd2a8568'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:48.523799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 993/2030] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:48 2022] DELETE /identity/v3/users/bcc08bce8ef248ceb8f6fc64fd2a8568 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:48.527561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.527561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:48.542281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c34e-a1a0-490c-a274-8c4ddd39e6fd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.607728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891fec1-7797-4757-8543-f77def23ff8e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.612751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0649a-2efe-4c41-97ab-2f87fa88c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.613126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.613426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0649a-2efe-4c41-97ab-2f87fa88c9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.613712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0649a-2efe-4c41-97ab-2f87fa88c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.613817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.613992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0649a-2efe-4c41-97ab-2f87fa88c9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.614093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.614313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.614722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0649a-2efe-4c41-97ab-2f87fa88c9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.615149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.616372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0649a-2efe-4c41-97ab-2f87fa88c9c5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.621139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.627787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 994/2031] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:48.629165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b3c1-880d-47e0-bf63-d0c433bee7e1 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.629458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b3c1-880d-47e0-bf63-d0c433bee7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.629777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b3c1-880d-47e0-bf63-d0c433bee7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.649465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-23f1b3c1-880d-47e0-bf63-d0c433bee7e1 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:48.651452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-23f1b3c1-880d-47e0-bf63-d0c433bee7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:48.660868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 995/2032] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:48.661367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b3c1-880d-47e0-bf63-d0c433bee7e1 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.672331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b3c1-880d-47e0-bf63-d0c433bee7e1 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.681024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.682609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.684102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.684411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.685169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.687418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.704985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 996/2033] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:48.705352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.707232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1038/2034] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:48 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:48.708325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.713996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:48.794604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c56101-62e9-4057-a176-d0cf6e27bbab admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.800239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af716ea-d259-4bfc-897b-0021b8c72e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.801420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af716ea-d259-4bfc-897b-0021b8c72e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.801784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af716ea-d259-4bfc-897b-0021b8c72e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.802140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af716ea-d259-4bfc-897b-0021b8c72e55 admin admin] PATH_INFO: `/v3/projects/3113894e75dd4ac3ac156ccd21817a48/users/6b1618673c204312ad268703722b7ac3/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.802859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff98ba-a6f1-4323-87d2-2075ec3b2e16 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.818991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af716ea-d259-4bfc-897b-0021b8c72e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3113894e75dd4ac3ac156ccd21817a48, user_id=6b1618673c204312ad268703722b7ac3, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.823102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af716ea-d259-4bfc-897b-0021b8c72e55 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.867675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.867675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.867675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.867675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.868408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.869710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.880388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 997/2035] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:48.880928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:48.882320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:48.895784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09d79b-f7da-441e-a16f-0d7e20687a6d service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:48.900809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:48.901523 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.901810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.902094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:48.902796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:48.904786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:48.963117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1039/2036] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:48 2022] PUT /identity/v3/projects/3113894e75dd4ac3ac156ccd21817a48/users/6b1618673c204312ad268703722b7ac3/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:48.977544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:48.977831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:48.978109 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.001804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 998/2037] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:48 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:49.004865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.007676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] MFA Rules not processed for user `6b1618673c204312ad268703722b7ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:49.008877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.014846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48fb17-e115-4b02-bbd5-c590c24e40d5 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.078863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.079620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.079775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1040/2038] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:49.079915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.080183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.080608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.081094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.081915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.083063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.102803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 999/2039] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:49.104496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.105612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25c0d0-a01e-4f08-9c0e-de682f189f39 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.107346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.122376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.124372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.124372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.124616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] PATH_INFO: `/v3/projects/eba2a373347d4340b782e6b983257913` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.126099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba2a373347d4340b782e6b983257913)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.128359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.173491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9136a7-2364-4ea0-9744-3d3caf72accd admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.177327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.178335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.178620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.178901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.189065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.190781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.201116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1000/2040] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:49.201989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.213730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada76a4-6d1b-4b13-aae0-b463583f0336 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.220724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.223583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.223583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.223583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.223583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.225221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.237439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1001/2041] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:49.241261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.254831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13794ecd-56e2-47ff-9bc9-32874862d17b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.277713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba2a373347d4340b782e6b983257913', 'request_id': 'req-f433da1f-870f-4aa7-8a2f-84bd25711d8b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.287309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba2a373347d4340b782e6b983257913', 'request_id': 'req-f433da1f-870f-4aa7-8a2f-84bd25711d8b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.336248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.338575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.338575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.338575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] PATH_INFO: `/v3/projects/81ec120b38534c9a80ea739ac55c1439/users/72492259276844abb3d3545131d79765/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.356218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ec120b38534c9a80ea739ac55c1439, user_id=72492259276844abb3d3545131d79765, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.359198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.369248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba2a373347d4340b782e6b983257913', 'request_id': 'req-f433da1f-870f-4aa7-8a2f-84bd25711d8b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.381095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] The token cache is being invalidate because project eba2a373347d4340b782e6b983257913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:49.381383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.382213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.383993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1041/2042] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:49 2022] DELETE /identity/v3/projects/eba2a373347d4340b782e6b983257913 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:49.387681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.389069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.424514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1002/2043] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:49 2022] PUT /identity/v3/projects/81ec120b38534c9a80ea739ac55c1439/users/72492259276844abb3d3545131d79765/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:49.427789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.429094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.452130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433da1f-870f-4aa7-8a2f-84bd25711d8b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.497191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d383d8-2739-4c2f-8b4a-814efa0a5a6a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.502363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.503183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.503454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.503764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] PATH_INFO: `/v3/users/a5f7d13b583648d8bbaba95918e58799` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.505207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7744730-15c5-4afb-bbdf-bb0b75bc50d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.505344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f7d13b583648d8bbaba95918e58799)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.505812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7744730-15c5-4afb-bbdf-bb0b75bc50d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.506356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7744730-15c5-4afb-bbdf-bb0b75bc50d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.506356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7744730-15c5-4afb-bbdf-bb0b75bc50d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.507285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.508433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b7744730-15c5-4afb-bbdf-bb0b75bc50d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.579384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7744730-15c5-4afb-bbdf-bb0b75bc50d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.580885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7744730-15c5-4afb-bbdf-bb0b75bc50d5 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.592179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1042/2044] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:49.593830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.593830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.594235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.621603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] MFA Rules not processed for user `72492259276844abb3d3545131d79765`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:49.622949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.702710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1043/2045] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:49.707566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.707566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.719181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb392ff-683d-4b1f-abab-a83834701ebd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.719887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f7d13b583648d8bbaba95918e58799'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.724977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:49.725858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:49.726134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:49.726411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] PATH_INFO: `/v3/projects/4978ac6205434cafb9d570ca71de575b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:49.727689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4978ac6205434cafb9d570ca71de575b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:49.733302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f7d13b583648d8bbaba95918e58799'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.733452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:49.796451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f7d13b583648d8bbaba95918e58799'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.809854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f7d13b583648d8bbaba95918e58799'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.810553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f7d13b583648d8bbaba95918e58799'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.816850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1003/2046] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:49 2022] DELETE /identity/v3/users/a5f7d13b583648d8bbaba95918e58799 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:49.817659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.819004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:49.846450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4978ac6205434cafb9d570ca71de575b', 'request_id': 'req-b7378743-3740-4128-a064-d24fd4036691'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.857118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4978ac6205434cafb9d570ca71de575b', 'request_id': 'req-b7378743-3740-4128-a064-d24fd4036691'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.925595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567ea9c-d7be-4048-8ad9-c4551bd9a009 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:49.948607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4978ac6205434cafb9d570ca71de575b', 'request_id': 'req-b7378743-3740-4128-a064-d24fd4036691'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.963135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] The token cache is being invalidate because project 4978ac6205434cafb9d570ca71de575b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:49.963135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.964037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:49.967329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1044/2047] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:49 2022] DELETE /identity/v3/projects/4978ac6205434cafb9d570ca71de575b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:49.971987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:49.974252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.003954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.004608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.004879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.005298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.006017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.008042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.062029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378743-3740-4128-a064-d24fd4036691 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.068245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.069376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.069658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.069975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] PATH_INFO: `/v3/users/24238b5832ae49339971690a8bc59b27` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.071263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24238b5832ae49339971690a8bc59b27)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.074691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.129893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1004/2048] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:49 2022] POST /identity/v3/projects => generated 381 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:50.133555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:50.137238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.220906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92454855-2fb2-4397-934a-d66428590d74 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.225852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.229052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.229052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.229052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.229052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.229906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.261797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24238b5832ae49339971690a8bc59b27'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.262774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24238b5832ae49339971690a8bc59b27'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.337270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24238b5832ae49339971690a8bc59b27'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.344927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1005/2049] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:50 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:50.345844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:50.349109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.362066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24238b5832ae49339971690a8bc59b27'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.362754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89fabb-da4a-4b62-a1ba-8cfd91687bf2 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.363058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24238b5832ae49339971690a8bc59b27'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.368510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.370643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.370971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.371434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] PATH_INFO: `/v3/projects/1bbbba92b8eb42a19d7a5f8a012abb1f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.374107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbbba92b8eb42a19d7a5f8a012abb1f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.378539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.393457 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1045/2050] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:49 2022] DELETE /identity/v3/users/24238b5832ae49339971690a8bc59b27 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:50.396606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:50.397021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.470481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d591-462f-499d-8e06-fc36bd35cb63 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.475456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.476164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.476444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.476720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.477515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.479770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.490036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1046/2051] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:50.495625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:50.505773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64e99-1802-4625-9c20-ed12dc9e9f72 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.510705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.516345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.516345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.516345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] PATH_INFO: `/v3/projects/cac0b413d04f4121aa4b0a9cefcb7ed8/users/1e588f83b16b4d62abc1fb221d16f76d/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.528637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbbba92b8eb42a19d7a5f8a012abb1f', 'request_id': 'req-16d3e27c-d665-4a85-a771-3b8d3e3d52db'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.529077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac0b413d04f4121aa4b0a9cefcb7ed8, user_id=1e588f83b16b4d62abc1fb221d16f76d, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.531810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.536197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbbba92b8eb42a19d7a5f8a012abb1f', 'request_id': 'req-16d3e27c-d665-4a85-a771-3b8d3e3d52db'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.736101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbbba92b8eb42a19d7a5f8a012abb1f', 'request_id': 'req-16d3e27c-d665-4a85-a771-3b8d3e3d52db'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.737709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1047/2052] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:50 2022] PUT /identity/v3/projects/cac0b413d04f4121aa4b0a9cefcb7ed8/users/1e588f83b16b4d62abc1fb221d16f76d/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:50.755572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] The token cache is being invalidate because project 1bbbba92b8eb42a19d7a5f8a012abb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:50.766142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.766142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16d3e27c-d665-4a85-a771-3b8d3e3d52db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:50.766142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1006/2053] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:50 2022] DELETE /identity/v3/projects/1bbbba92b8eb42a19d7a5f8a012abb1f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:50.767139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:50.768446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.770380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43782-bab8-4a3b-b1ff-efe51163ecd6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.770684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43782-bab8-4a3b-b1ff-efe51163ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.770982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43782-bab8-4a3b-b1ff-efe51163ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.793221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-d5e43782-bab8-4a3b-b1ff-efe51163ecd6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:50.794534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d5e43782-bab8-4a3b-b1ff-efe51163ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.852347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a1425-1fe3-4edd-870c-176be008a1f5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.858849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.859629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.860024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.860356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.861150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.862787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.864678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1007/2054] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:50.872505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cec3-eea5-4e92-ba6b-54e1594bd531 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.872787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cec3-eea5-4e92-ba6b-54e1594bd531 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.873067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cec3-eea5-4e92-ba6b-54e1594bd531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.876608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1048/2055] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:50.880723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:50.894869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204591b4-e533-47ed-b420-0b52446e3164 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.896994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a226cec3-eea5-4e92-ba6b-54e1594bd531 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:50.898212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a226cec3-eea5-4e92-ba6b-54e1594bd531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.904176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5f30b-c2fd-47e4-80b3-78e6f5df2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.905076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f30b-c2fd-47e4-80b3-78e6f5df2b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.905360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f30b-c2fd-47e4-80b3-78e6f5df2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.905625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f30b-c2fd-47e4-80b3-78e6f5df2b00 admin admin] PATH_INFO: `/v3/projects/cac0b413d04f4121aa4b0a9cefcb7ed8/users/1e588f83b16b4d62abc1fb221d16f76d/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.907781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5f30b-c2fd-47e4-80b3-78e6f5df2b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac0b413d04f4121aa4b0a9cefcb7ed8, user_id=1e588f83b16b4d62abc1fb221d16f76d, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.911511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1008/2056] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:50.911663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5f30b-c2fd-47e4-80b3-78e6f5df2b00 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:50.912757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226cec3-eea5-4e92-ba6b-54e1594bd531 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:50.922727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1049/2057] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:50 2022] PUT /identity/v3/projects/cac0b413d04f4121aa4b0a9cefcb7ed8/users/1e588f83b16b4d62abc1fb221d16f76d/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:50.925965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226cec3-eea5-4e92-ba6b-54e1594bd531 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:50.934295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c0e9c-c404-4bce-8d7f-f2e3a7a706cb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.934696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c0e9c-c404-4bce-8d7f-f2e3a7a706cb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.934983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c0e9c-c404-4bce-8d7f-f2e3a7a706cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.964754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-131c0e9c-c404-4bce-8d7f-f2e3a7a706cb None None] MFA Rules not processed for user `1e588f83b16b4d62abc1fb221d16f76d`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:50.965407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-131c0e9c-c404-4bce-8d7f-f2e3a7a706cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:50.993009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:50.993717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:50.994013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:50.994404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:50.995032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:50.995344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:50.997110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.013618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1009/2058] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:51.014579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.017938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:51.039780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fd00-65fb-4761-83bb-937d0b3e1e26 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.047334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.048277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.048705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.048968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] PATH_INFO: `/v3/projects/86e7b793c5e3425ea6366fc2957c11d6` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.050886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e7b793c5e3425ea6366fc2957c11d6)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.053481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.066451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1050/2059] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:51.068851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c0e9c-c404-4bce-8d7f-f2e3a7a706cb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.077718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c0e9c-c404-4bce-8d7f-f2e3a7a706cb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.083278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.083982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.084269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.084547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.085249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.087163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.166791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e7b793c5e3425ea6366fc2957c11d6', 'request_id': 'req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:51.173505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e7b793c5e3425ea6366fc2957c11d6', 'request_id': 'req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:51.208986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1051/2060] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:51 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:51.209171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.210707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:51.273671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a383715-d359-46a7-9c8b-d3b6a798e044 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.279505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347b6ca-49bc-475c-80ec-3f000fdbc7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.280203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e7b793c5e3425ea6366fc2957c11d6', 'request_id': 'req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:51.280326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347b6ca-49bc-475c-80ec-3f000fdbc7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.280715 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347b6ca-49bc-475c-80ec-3f000fdbc7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.281033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347b6ca-49bc-475c-80ec-3f000fdbc7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.294850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] The token cache is being invalidate because project 86e7b793c5e3425ea6366fc2957c11d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:51.295258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:51.295946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:51.300738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1010/2061] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:51 2022] DELETE /identity/v3/projects/86e7b793c5e3425ea6366fc2957c11d6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:51.300738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.300738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:51.353024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347b6ca-49bc-475c-80ec-3f000fdbc7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.354639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347b6ca-49bc-475c-80ec-3f000fdbc7c2 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.367625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1052/2062] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:51.372495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248ee0f-175b-4c93-8ea5-b4a6c45d5ab8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.372495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248ee0f-175b-4c93-8ea5-b4a6c45d5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.372495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248ee0f-175b-4c93-8ea5-b4a6c45d5ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.376482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b4960-afe4-49fb-bdcd-bb5f470b6ed7 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.389587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f248ee0f-175b-4c93-8ea5-b4a6c45d5ab8 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:51.390818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f248ee0f-175b-4c93-8ea5-b4a6c45d5ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:51.449758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.450706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.450991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.451269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.452337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.454560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.489253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1053/2063] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:51.496033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30540344-a8ba-4f11-aeee-620ddf881093 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.496384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30540344-a8ba-4f11-aeee-620ddf881093 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.496670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30540344-a8ba-4f11-aeee-620ddf881093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.525039 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-30540344-a8ba-4f11-aeee-620ddf881093 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:51.526911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-30540344-a8ba-4f11-aeee-620ddf881093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:51.538531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1054/2064] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:51.543373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30540344-a8ba-4f11-aeee-620ddf881093 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.554070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30540344-a8ba-4f11-aeee-620ddf881093 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.559398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.560353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.560636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.560914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.561856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:51.562243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.564299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.581223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1055/2065] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:51.581849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1011/2066] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:51 2022] POST /identity/v3/users => generated 296 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:51.582667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.587422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.596652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edbc7a-b9ce-4792-831b-9bca0b7bf2bc admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.600086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb090-3afe-4158-ae05-667a8c63f5ea admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.601614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.602277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.602741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.603019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.603776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.605758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.606321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.613002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.613002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.613002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.613002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.613002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.631757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1012/2067] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:51.636760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.648576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978e1f-2a74-4d9d-a95f-9c8904a7c13b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.655175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.656410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.657252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.657763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.659198 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.662483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.678509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1013/2068] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:51.683492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.693537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5583-c4b6-445a-9de6-d97b327e79ce admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.699532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68122a32-ae05-4cfb-9591-f9bbc6b68828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.700436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68122a32-ae05-4cfb-9591-f9bbc6b68828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.700873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68122a32-ae05-4cfb-9591-f9bbc6b68828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.701539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68122a32-ae05-4cfb-9591-f9bbc6b68828 admin admin] PATH_INFO: `/v3/projects/6a54aedaf3e54f678df5bff5faf44b12/users/7b5c9dfd8c66444b9394dc086728a159/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.717493 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68122a32-ae05-4cfb-9591-f9bbc6b68828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a54aedaf3e54f678df5bff5faf44b12, user_id=7b5c9dfd8c66444b9394dc086728a159, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.721251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68122a32-ae05-4cfb-9591-f9bbc6b68828 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.728616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1056/2069] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:51 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:51.732973 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:51.800132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1014/2070] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:51 2022] PUT /identity/v3/projects/6a54aedaf3e54f678df5bff5faf44b12/users/7b5c9dfd8c66444b9394dc086728a159/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:51.803839 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d272c4-d26e-4aec-8c56-fc570096bfb3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:51.812782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013fdf2-6985-47ee-91cc-d27c0912a6de None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.813019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013fdf2-6985-47ee-91cc-d27c0912a6de None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.813248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013fdf2-6985-47ee-91cc-d27c0912a6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.843392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6013fdf2-6985-47ee-91cc-d27c0912a6de None None] MFA Rules not processed for user `7b5c9dfd8c66444b9394dc086728a159`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:51.844981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6013fdf2-6985-47ee-91cc-d27c0912a6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:51.873687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:51.874372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:51.874656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:51.874928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:51.875682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:51.877672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:51.923876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1015/2071] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:51.995167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1057/2072] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:51 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:51.999507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013fdf2-6985-47ee-91cc-d27c0912a6de None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.010254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013fdf2-6985-47ee-91cc-d27c0912a6de None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.015031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.015884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.016134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.016366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.017104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.018796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.036653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.038517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1016/2073] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:52.039410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:52.044675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.056018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465a72-4548-4311-8634-51cc6cb9507e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.061378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.062046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.062355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.062632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.064967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.065078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.075692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1017/2074] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:52.080162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.091244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123948-4306-4218-8351-2db8c482331d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.096713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.097611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.097896 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.098179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] PATH_INFO: `/v3/projects/770a05e204ea432982bc0869dfb1526d/users/f62fb5360b28480c87277c69c1eb973b/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.103870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42086551-ed83-4da4-897e-09e69d7b883f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.107706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8038c-4f93-4e4d-98b2-1fd40e1c2bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.108383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8038c-4f93-4e4d-98b2-1fd40e1c2bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.108668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8038c-4f93-4e4d-98b2-1fd40e1c2bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.108948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8038c-4f93-4e4d-98b2-1fd40e1c2bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.113977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770a05e204ea432982bc0869dfb1526d, user_id=f62fb5360b28480c87277c69c1eb973b, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.116753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.117894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8038c-4f93-4e4d-98b2-1fd40e1c2bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.119988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8038c-4f93-4e4d-98b2-1fd40e1c2bf4 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.129215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1058/2075] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:52.209672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1018/2076] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:52 2022] PUT /identity/v3/projects/770a05e204ea432982bc0869dfb1526d/users/f62fb5360b28480c87277c69c1eb973b/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:52.221321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.221618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.221898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.250750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] MFA Rules not processed for user `f62fb5360b28480c87277c69c1eb973b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:52.252268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:52.317556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1059/2077] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:52.322555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.397727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4095b-b394-49f0-8db2-096e3f444153 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.403356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.404063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.404350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.404629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.405337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.407386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.408467 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.410125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:52.476447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b6a24-85a3-40c0-beb2-2475dee3e5d6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.485388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e588f83b16b4d62abc1fb221d16f76d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac0b413d04f4121aa4b0a9cefcb7ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.486067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.486355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.486693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.487420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:52.487763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.493193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.506170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1060/2078] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:52.510526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.522993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b514-db8c-40d6-ac54-79bbef23fde7 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.528936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e588f83b16b4d62abc1fb221d16f76d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac0b413d04f4121aa4b0a9cefcb7ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.529414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.529699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.529978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.530663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.532590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.566600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1019/2079] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:52 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:52.569424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.630341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5384594-5fbd-4fe4-8a4a-d94350a8d160 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.638091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.638777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.639068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.639343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.640069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.642142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.669340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1061/2080] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:52 2022] POST /identity/v3/projects => generated 355 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:52.670398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.733667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c1c5-e5aa-4acd-9da4-a92dbd91e4cc tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.738763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e588f83b16b4d62abc1fb221d16f76d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac0b413d04f4121aa4b0a9cefcb7ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.739592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.739884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.740166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.740901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:52.741272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.742832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.756015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1062/2081] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:52.774094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1020/2082] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:52 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:52.781994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.794004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.845479 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd18557-e6df-42c6-8446-4928aff1c561 tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.850145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.854290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.854290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.854290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.854290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.854668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.858460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0ddb-428c-4e1c-aaf4-cfad6e3aa4d6 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.863546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e588f83b16b4d62abc1fb221d16f76d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac0b413d04f4121aa4b0a9cefcb7ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.864444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.864736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.865021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] PATH_INFO: `/v3/projects/26eca4a2ef1040b7a6e77698a262a24d` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.865559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1063/2083] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:52.866342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorizing `identity:delete_project(project_id=26eca4a2ef1040b7a6e77698a262a24d)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.868354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:52.870671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:52.880717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c200bb-416f-407b-98c9-490da727d028 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:52.885445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:52.886625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:52.886625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:52.886860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] PATH_INFO: `/v3/projects/ca62f3e0bbb348ca95de2a20b00bed86/users/110d255da7d54d3695625f9964f63036/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:52.902299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca62f3e0bbb348ca95de2a20b00bed86, user_id=110d255da7d54d3695625f9964f63036, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:52.904989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:53.086080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1064/2084] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:52 2022] PUT /identity/v3/projects/ca62f3e0bbb348ca95de2a20b00bed86/users/110d255da7d54d3695625f9964f63036/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:53.090431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:53.095238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26eca4a2ef1040b7a6e77698a262a24d', 'request_id': 'req-fa444d99-744d-4c71-8d4d-6e6c46032bdf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:53.101919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26eca4a2ef1040b7a6e77698a262a24d', 'request_id': 'req-fa444d99-744d-4c71-8d4d-6e6c46032bdf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:53.156967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a470e9-41dc-44ad-bfeb-506235442d4e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:53.178953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26eca4a2ef1040b7a6e77698a262a24d', 'request_id': 'req-fa444d99-744d-4c71-8d4d-6e6c46032bdf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:53.190457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] The token cache is being invalidate because project 26eca4a2ef1040b7a6e77698a262a24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:53.190746 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:53.191394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:53.193291 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1021/2085] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:52 2022] DELETE /identity/v3/projects/26eca4a2ef1040b7a6e77698a262a24d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:53.215303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f0c5-ae68-405b-8f7f-a83991d4c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:53.218064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f0c5-ae68-405b-8f7f-a83991d4c1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:53.218064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f0c5-ae68-405b-8f7f-a83991d4c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:53.218064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f0c5-ae68-405b-8f7f-a83991d4c1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:53.218064 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f0c5-ae68-405b-8f7f-a83991d4c1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:53.219075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f0c5-ae68-405b-8f7f-a83991d4c1fc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:53.229713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1065/2086] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:53.233971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:53.235452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:53.250016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444d99-744d-4c71-8d4d-6e6c46032bdf tempest-VolumeQuotaClassesTest-1402512873 tempest-VolumeQuotaClassesTest-1402512873-project-admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:53.254730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:53.255652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:53.255939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:53.256216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] PATH_INFO: `/v3/projects/ca62f3e0bbb348ca95de2a20b00bed86/users/110d255da7d54d3695625f9964f63036/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:53.258203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca62f3e0bbb348ca95de2a20b00bed86, user_id=110d255da7d54d3695625f9964f63036, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:53.261505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:53.272171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1022/2087] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:53 2022] PUT /identity/v3/projects/ca62f3e0bbb348ca95de2a20b00bed86/users/110d255da7d54d3695625f9964f63036/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:53.284260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8936-6114-4d67-939a-3c5e61c3d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:53.284544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8936-6114-4d67-939a-3c5e61c3d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:53.284821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8936-6114-4d67-939a-3c5e61c3d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:53.311845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-db8c8936-6114-4d67-939a-3c5e61c3d5d2 None None] MFA Rules not processed for user `110d255da7d54d3695625f9964f63036`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:53.313053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-db8c8936-6114-4d67-939a-3c5e61c3d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:53.384054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1066/2088] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:53.428620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:53.430432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:53.488931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777459a-c4ae-4729-8006-ffbef89066b9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:53.492614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:53.493265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:53.493574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:53.494468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:53.503872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:53.505367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:53.515257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1023/2089] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:53.683923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c8936-6114-4d67-939a-3c5e61c3d5d2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:53.768116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c8936-6114-4d67-939a-3c5e61c3d5d2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:53.772577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:53.773442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:53.773723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:53.774078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] PATH_INFO: `/v3/users/f62fb5360b28480c87277c69c1eb973b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:53.775359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62fb5360b28480c87277c69c1eb973b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:53.777302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:53.889138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:53.890597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:53.905205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e0256-286e-4365-bedb-bd36dfc8c686 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:53.909783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:53.910645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:53.915327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:53.915327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] PATH_INFO: `/v3/users/72492259276844abb3d3545131d79765` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:53.915327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72492259276844abb3d3545131d79765)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:53.915327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:53.993835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62fb5360b28480c87277c69c1eb973b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:53.994486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62fb5360b28480c87277c69c1eb973b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.053932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62fb5360b28480c87277c69c1eb973b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.061929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62fb5360b28480c87277c69c1eb973b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.062671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2319bbd4-a2f1-4f75-b068-35787484be38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62fb5360b28480c87277c69c1eb973b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.083248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1067/2090] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:53 2022] DELETE /identity/v3/users/f62fb5360b28480c87277c69c1eb973b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:54.088235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:54.088795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:54.088795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:54.107230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:54.108537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:54.108675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72492259276844abb3d3545131d79765'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.116607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72492259276844abb3d3545131d79765'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.168299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1068/2091] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:54.173798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72492259276844abb3d3545131d79765'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.177848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:54.179281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:54.186567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72492259276844abb3d3545131d79765'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.187238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-aad11462-de44-4b5f-b26b-2977d26bd5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72492259276844abb3d3545131d79765'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:54.194259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1024/2092] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:53 2022] DELETE /identity/v3/users/72492259276844abb3d3545131d79765 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:54.200922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:54.201206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:54.201488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:54.219033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:54.220593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:54.237032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81d581-755e-4cbb-af66-eefe38f0c49e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:54.284936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1025/2093] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:54.290826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:54.291481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:54.291772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:54.292049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:54.293883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:54.295427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:54.296896 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:54.307636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:54.308649 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f25fb-afbc-4708-bd0a-9234a80bbcf4 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:54.309332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:54.312425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:54.313070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:54.313348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:54.313624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:54.320025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1069/2094] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:54.324621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:54.326160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:54.336699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1026/2095] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:54.912487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:54.914036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:54.930992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f062f-5270-46c3-a9d1-404e11074b21 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:54.939867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:54.939867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:54.939867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:54.939867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] PATH_INFO: `/v3/projects/770a05e204ea432982bc0869dfb1526d` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:54.941982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:54.943506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:54.946606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770a05e204ea432982bc0869dfb1526d)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:54.949300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:54.959066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e31fd-c5aa-45e7-81d7-c2f527cde095 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:54.964354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:54.965306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:54.965587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:54.965872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] PATH_INFO: `/v3/projects/81ec120b38534c9a80ea739ac55c1439` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:54.967721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ec120b38534c9a80ea739ac55c1439)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:54.970474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:55.086687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ec120b38534c9a80ea739ac55c1439', 'request_id': 'req-39db1289-4197-4dad-91f3-9a65c9a9ad13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.091662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770a05e204ea432982bc0869dfb1526d', 'request_id': 'req-4052a17b-63b4-4823-97f8-1c72bc78f1d0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.100438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ec120b38534c9a80ea739ac55c1439', 'request_id': 'req-39db1289-4197-4dad-91f3-9a65c9a9ad13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.106524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770a05e204ea432982bc0869dfb1526d', 'request_id': 'req-4052a17b-63b4-4823-97f8-1c72bc78f1d0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.197091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ec120b38534c9a80ea739ac55c1439', 'request_id': 'req-39db1289-4197-4dad-91f3-9a65c9a9ad13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.208012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] The token cache is being invalidate because project 81ec120b38534c9a80ea739ac55c1439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:55.208303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.208951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.210489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1027/2096] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:54 2022] DELETE /identity/v3/projects/81ec120b38534c9a80ea739ac55c1439 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:55.214260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:55.215604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:55.277985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1289-4197-4dad-91f3-9a65c9a9ad13 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:55.333710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770a05e204ea432982bc0869dfb1526d', 'request_id': 'req-4052a17b-63b4-4823-97f8-1c72bc78f1d0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.339200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:55.340141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:55.340424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:55.340702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] PATH_INFO: `/v3/users/1e588f83b16b4d62abc1fb221d16f76d` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:55.341942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e588f83b16b4d62abc1fb221d16f76d)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:55.344005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:55.346249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] The token cache is being invalidate because project 770a05e204ea432982bc0869dfb1526d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:55.346538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.347213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.348840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1070/2097] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:54 2022] DELETE /identity/v3/projects/770a05e204ea432982bc0869dfb1526d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:55.354078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:55.355572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:55.368591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052a17b-63b4-4823-97f8-1c72bc78f1d0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:55.374361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:55.375412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:55.375720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:55.375993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] PATH_INFO: `/v3/users/110d255da7d54d3695625f9964f63036` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:55.378830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110d255da7d54d3695625f9964f63036)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:55.380608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:55.547396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e588f83b16b4d62abc1fb221d16f76d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.554540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e588f83b16b4d62abc1fb221d16f76d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.570320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110d255da7d54d3695625f9964f63036'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.570979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110d255da7d54d3695625f9964f63036'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.656558 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e588f83b16b4d62abc1fb221d16f76d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.673762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e588f83b16b4d62abc1fb221d16f76d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.674637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e588f83b16b4d62abc1fb221d16f76d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.682682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1028/2098] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:55 2022] DELETE /identity/v3/users/1e588f83b16b4d62abc1fb221d16f76d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:55.747654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110d255da7d54d3695625f9964f63036'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.757258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110d255da7d54d3695625f9964f63036'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.757258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110d255da7d54d3695625f9964f63036'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:55.776754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1071/2099] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:31:55 2022] DELETE /identity/v3/users/110d255da7d54d3695625f9964f63036 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:56.343929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:56.345654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:56.380367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:56.381787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:56.438189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f44c27-11d6-4a99-895a-45bbf94edafd admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:56.464863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279efa99-a611-4310-9869-d52b2b9de1c7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:56.470873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:56.471896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.472311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.472661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] PATH_INFO: `/v3/projects/ca62f3e0bbb348ca95de2a20b00bed86` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.473987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca62f3e0bbb348ca95de2a20b00bed86)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:56.476198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:56.501573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:56.502452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.502736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.503017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] PATH_INFO: `/v3/projects/cac0b413d04f4121aa4b0a9cefcb7ed8` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.504268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac0b413d04f4121aa4b0a9cefcb7ed8)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:56.506203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:56.619952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca62f3e0bbb348ca95de2a20b00bed86', 'request_id': 'req-ddbdd93f-8e60-4914-a1cd-163776cb851b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.626111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca62f3e0bbb348ca95de2a20b00bed86', 'request_id': 'req-ddbdd93f-8e60-4914-a1cd-163776cb851b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.677152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac0b413d04f4121aa4b0a9cefcb7ed8', 'request_id': 'req-9a2bddcf-9e70-46b0-b6db-86c004e9867f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.684333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac0b413d04f4121aa4b0a9cefcb7ed8', 'request_id': 'req-9a2bddcf-9e70-46b0-b6db-86c004e9867f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.741415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca62f3e0bbb348ca95de2a20b00bed86', 'request_id': 'req-ddbdd93f-8e60-4914-a1cd-163776cb851b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.758569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] The token cache is being invalidate because project ca62f3e0bbb348ca95de2a20b00bed86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:56.758871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.760582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ddbdd93f-8e60-4914-a1cd-163776cb851b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.761431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1072/2100] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:56 2022] DELETE /identity/v3/projects/ca62f3e0bbb348ca95de2a20b00bed86 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:56.766468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d86c8-c836-485a-ac3f-26bc5ec2bc28 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.766756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d86c8-c836-485a-ac3f-26bc5ec2bc28 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.767036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d86c8-c836-485a-ac3f-26bc5ec2bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.785208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4f6d86c8-c836-485a-ac3f-26bc5ec2bc28 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:56.786428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4f6d86c8-c836-485a-ac3f-26bc5ec2bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:56.822935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac0b413d04f4121aa4b0a9cefcb7ed8', 'request_id': 'req-9a2bddcf-9e70-46b0-b6db-86c004e9867f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.839684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] The token cache is being invalidate because project cac0b413d04f4121aa4b0a9cefcb7ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:31:56.840125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.840957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-9a2bddcf-9e70-46b0-b6db-86c004e9867f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:31:56.842839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1029/2101] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:31:56 2022] DELETE /identity/v3/projects/cac0b413d04f4121aa4b0a9cefcb7ed8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:56.849025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf27ee-6e9a-4c34-82da-116918bfaf7b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.849672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf27ee-6e9a-4c34-82da-116918bfaf7b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.850192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf27ee-6e9a-4c34-82da-116918bfaf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.859967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1073/2102] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:56.862824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691210-d84a-414e-8072-cf9a30051621 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.863367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691210-d84a-414e-8072-cf9a30051621 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.863939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691210-d84a-414e-8072-cf9a30051621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.884617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bcaf27ee-6e9a-4c34-82da-116918bfaf7b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:56.886470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bcaf27ee-6e9a-4c34-82da-116918bfaf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:56.893215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8c691210-d84a-414e-8072-cf9a30051621 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:56.895115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8c691210-d84a-414e-8072-cf9a30051621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:56.898812 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1030/2103] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:56.905316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1074/2104] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:56.906968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0c419-9d7c-4bbe-bfa5-a65bb6cc7715 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.907261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0c419-9d7c-4bbe-bfa5-a65bb6cc7715 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.907587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0c419-9d7c-4bbe-bfa5-a65bb6cc7715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.909494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691210-d84a-414e-8072-cf9a30051621 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:56.920377 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691210-d84a-414e-8072-cf9a30051621 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:56.925260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:56.925927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.926209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.926545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.927245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e0a0c419-9d7c-4bbe-bfa5-a65bb6cc7715 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:56.927359 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:56.927606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:56.928494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e0a0c419-9d7c-4bbe-bfa5-a65bb6cc7715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:56.929217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:56.936828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1031/2105] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:56.941159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0c419-9d7c-4bbe-bfa5-a65bb6cc7715 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:56.946096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1075/2106] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:56.947699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:56.951026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0c419-9d7c-4bbe-bfa5-a65bb6cc7715 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:56.956644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:56.957298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.957654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.958001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.959147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:56.959570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:56.959684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445a2d-aa59-4319-a5e9-4273a79a8a5c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:56.961370 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:56.968086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:56.968761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:56.969046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:56.969593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:56.970483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:56.972455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:56.975921 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1032/2107] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:31:56.981572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:56.990986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb7e2f-e4cd-45eb-95cf-20726c07d35f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:56.995927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.001345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.001345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.001345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.001345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.001345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.049904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1076/2108] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:56 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:57.054102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.070901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1033/2109] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:56 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:57.075112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.125285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b41c32-4fab-4321-b989-9ee90ce2c19d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.146473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fef3d-a9b5-4f5f-ab7e-ea71f290858d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.151985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.152685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.153090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.153373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.154070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.156045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.191630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.191630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.191630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.191630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.192010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.193220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.254927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1034/2110] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:57.258871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.270084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb9a47-b60f-4a1e-bd84-3a081ae44343 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.276880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.277545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.277918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.278230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.278956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.280583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.292585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1077/2111] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:57.293790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.301210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1035/2112] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:57.302220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.313244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280725-d6c4-4efb-9e35-80c64689caa4 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.326177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b68f72-4140-4e6d-b454-cab8255edfe6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.332009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.333339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.333690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.334081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.335295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.338333 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.339576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.340092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.340597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.341991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.345488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.346498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.367611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1036/2113] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:57.375611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1078/2114] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:57.375758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.376253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.389163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1c80-6689-465a-93a7-95845fd5d695 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.392981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f994-3e24-4d04-a9aa-928e46543881 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.394906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ab009-83e7-4253-aa5f-a0e5231cf0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.396068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ab009-83e7-4253-aa5f-a0e5231cf0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.396411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ab009-83e7-4253-aa5f-a0e5231cf0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.399703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ab009-83e7-4253-aa5f-a0e5231cf0a2 admin admin] PATH_INFO: `/v3/projects/fd1d3e5710664e75ac8d9514956450c1/users/bbe002025e5e47bcbcf365ffcb0fa0fb/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.399899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.399899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.399899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.399899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.400870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.402376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.414515 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1079/2115] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:31:57.418704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ab009-83e7-4253-aa5f-a0e5231cf0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1d3e5710664e75ac8d9514956450c1, user_id=bbe002025e5e47bcbcf365ffcb0fa0fb, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.419036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.424984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ab009-83e7-4253-aa5f-a0e5231cf0a2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.430096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97736c0d-653d-465a-94e1-d2b18de82c5c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.436491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2c849-4c9c-4ea9-a949-f87f39494e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.437403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2c849-4c9c-4ea9-a949-f87f39494e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.437681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2c849-4c9c-4ea9-a949-f87f39494e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.437950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2c849-4c9c-4ea9-a949-f87f39494e51 admin admin] PATH_INFO: `/v3/projects/caa6faf95a264a2cb4961f50442e178f/users/0a8bc131b3ba4ed0a310d49eecdec273/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.456808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2c849-4c9c-4ea9-a949-f87f39494e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa6faf95a264a2cb4961f50442e178f, user_id=0a8bc131b3ba4ed0a310d49eecdec273, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.459448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2c849-4c9c-4ea9-a949-f87f39494e51 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.515315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1037/2116] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:57 2022] PUT /identity/v3/projects/fd1d3e5710664e75ac8d9514956450c1/users/bbe002025e5e47bcbcf365ffcb0fa0fb/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:57.527011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4708-25a6-488a-81e5-c0724720f6ea None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.527298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4708-25a6-488a-81e5-c0724720f6ea None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.527618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4708-25a6-488a-81e5-c0724720f6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.554021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-485b4708-25a6-488a-81e5-c0724720f6ea None None] MFA Rules not processed for user `bbe002025e5e47bcbcf365ffcb0fa0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:57.555234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-485b4708-25a6-488a-81e5-c0724720f6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:57.565675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1080/2117] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:57 2022] PUT /identity/v3/projects/caa6faf95a264a2cb4961f50442e178f/users/0a8bc131b3ba4ed0a310d49eecdec273/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:57.577552 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d1da-ca7e-4b20-be87-151b51872fbe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.577950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d1da-ca7e-4b20-be87-151b51872fbe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.578230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d1da-ca7e-4b20-be87-151b51872fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.605308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0f31d1da-ca7e-4b20-be87-151b51872fbe None None] MFA Rules not processed for user `0a8bc131b3ba4ed0a310d49eecdec273`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:57.606577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0f31d1da-ca7e-4b20-be87-151b51872fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:57.621699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1038/2118] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:57.626341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4708-25a6-488a-81e5-c0724720f6ea None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.698135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1081/2119] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:57.702999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d1da-ca7e-4b20-be87-151b51872fbe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.719637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4708-25a6-488a-81e5-c0724720f6ea None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.784976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d1da-ca7e-4b20-be87-151b51872fbe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.791153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.791966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.792360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.793842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.793842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.794050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.796241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.796241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.796402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.796488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.796975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.799703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:57.883914 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1039/2120] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/projects => generated 393 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:57.888863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.913572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1082/2121] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:31:57.915097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:57.961118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b709c-710f-4518-86b2-0c229674784a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.984948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3fac9-a738-4dd5-9003-af471ff029e2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:57.990152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:57.990862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:57.991151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:57.991432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:57.992207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:57.994835 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.031652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.032260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.032545 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.032829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.033562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.035625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.084230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1083/2122] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:58.090808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.101880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d447e-6199-47b0-8e45-736aae04047a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.107160 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.107908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.108199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.108477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.109368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.110976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.122729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1084/2123] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:58.127533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.138596 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900ea41-9473-4eec-866d-c7cd86684993 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.144562 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.145484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.145770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.146051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] PATH_INFO: `/v3/projects/cad415b712fa43c8902fdb956ec86343/users/ef2121d2a539468aad89b90cf4e6cbd1/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.163799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad415b712fa43c8902fdb956ec86343, user_id=ef2121d2a539468aad89b90cf4e6cbd1, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.166891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.176414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1040/2124] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:31:57 2022] POST /identity/v3/users => generated 303 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:31:58.182287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.192462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cd12b-728f-4478-bf37-c9cf398cd592 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.197782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.198457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.198734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.199011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.199775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.201383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.211967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1041/2125] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:58.216766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.227291 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04662c8b-121f-49f1-b464-c92651d6bdb5 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.232552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.233452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.233735 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.234014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] PATH_INFO: `/v3/projects/88f4a9c96d6c46d08c4635a626441e86/users/c02ad90418b544ebab723cb6e73edfe7/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.251092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f4a9c96d6c46d08c4635a626441e86, user_id=c02ad90418b544ebab723cb6e73edfe7, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.251303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1085/2126] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:58 2022] PUT /identity/v3/projects/cad415b712fa43c8902fdb956ec86343/users/ef2121d2a539468aad89b90cf4e6cbd1/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:58.253852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.255419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.323944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4afc7-d676-465c-9e91-6df90217df2d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.329386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.330067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.330353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.330634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.331366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.333030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.334944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1042/2127] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:58 2022] PUT /identity/v3/projects/88f4a9c96d6c46d08c4635a626441e86/users/c02ad90418b544ebab723cb6e73edfe7/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:58.339666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.348624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1086/2128] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:58.352352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.364226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4e50-7b45-42c3-a8fe-45ea53e416d8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.405500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3aa39-903e-46ed-988d-435b819edf7c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.412303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.412988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.413279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.413556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.414293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.416020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.427431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1043/2129] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:31:58.432491 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.440142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7699d1a-aac0-497a-93b2-c3c45fa279a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.441172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7699d1a-aac0-497a-93b2-c3c45fa279a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.441456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7699d1a-aac0-497a-93b2-c3c45fa279a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.441737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7699d1a-aac0-497a-93b2-c3c45fa279a0 admin admin] PATH_INFO: `/v3/projects/cad415b712fa43c8902fdb956ec86343/users/ef2121d2a539468aad89b90cf4e6cbd1/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.444031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7699d1a-aac0-497a-93b2-c3c45fa279a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad415b712fa43c8902fdb956ec86343, user_id=ef2121d2a539468aad89b90cf4e6cbd1, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.445685 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e63100-4be8-4e8a-b4f1-88a383d770af admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.447392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7699d1a-aac0-497a-93b2-c3c45fa279a0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.452227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefc1bc-5eb0-4d6a-9493-da99bd8cdeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.453440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc1bc-5eb0-4d6a-9493-da99bd8cdeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.453808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc1bc-5eb0-4d6a-9493-da99bd8cdeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.454146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc1bc-5eb0-4d6a-9493-da99bd8cdeeb admin admin] PATH_INFO: `/v3/projects/88f4a9c96d6c46d08c4635a626441e86/users/c02ad90418b544ebab723cb6e73edfe7/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.457751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefc1bc-5eb0-4d6a-9493-da99bd8cdeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f4a9c96d6c46d08c4635a626441e86, user_id=c02ad90418b544ebab723cb6e73edfe7, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.458945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1087/2130] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:58 2022] PUT /identity/v3/projects/cad415b712fa43c8902fdb956ec86343/users/ef2121d2a539468aad89b90cf4e6cbd1/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:58.461176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefc1bc-5eb0-4d6a-9493-da99bd8cdeeb admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.470563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.471230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.471841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.479760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1044/2131] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:31:58 2022] PUT /identity/v3/projects/88f4a9c96d6c46d08c4635a626441e86/users/c02ad90418b544ebab723cb6e73edfe7/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:31:58.491180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.491693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.492473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.515134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] MFA Rules not processed for user `ef2121d2a539468aad89b90cf4e6cbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:58.516452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:58.527112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] MFA Rules not processed for user `c02ad90418b544ebab723cb6e73edfe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:58.528744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:58.601646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1088/2132] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:58.613019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.614927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:58.619541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1045/2133] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:58.633991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.636553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:58.686634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449de16-3c3f-4605-bfa1-f882779007b5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.690348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.691000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.691283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.691607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.705898 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9294f3-6457-4f75-b9fb-abd9f7f6819a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.709845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.710515 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.711137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.711137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.721679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.723151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.734555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1046/2134] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:58.789342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.791376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.802082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1089/2135] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:31:58.825063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:58.836541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06dab-0b0f-4edf-801f-dc71f09f339d service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:58.842279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f80b5-fc7d-4dcd-989a-2403674a0817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:58.843610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f80b5-fc7d-4dcd-989a-2403674a0817 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:58.844087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f80b5-fc7d-4dcd-989a-2403674a0817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:58.844926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f80b5-fc7d-4dcd-989a-2403674a0817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:58.924266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f80b5-fc7d-4dcd-989a-2403674a0817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:58.926043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f80b5-fc7d-4dcd-989a-2403674a0817 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:58.939096 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1047/2136] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:02.411336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:02.412794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:02.544196 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ba3af-c2fe-44e1-809e-67166800babb service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:02.548847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:02.549962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:02.550262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:02.550556 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] PATH_INFO: `/v3/users/6b1618673c204312ad268703722b7ac3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:02.551805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1618673c204312ad268703722b7ac3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:02.553791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:02.736491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1618673c204312ad268703722b7ac3'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:02.737154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1618673c204312ad268703722b7ac3'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:02.793633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1618673c204312ad268703722b7ac3'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:02.801471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1618673c204312ad268703722b7ac3'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:02.802191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1618673c204312ad268703722b7ac3'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:02.819799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1090/2137] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:02 2022] DELETE /identity/v3/users/6b1618673c204312ad268703722b7ac3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:02.825912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:02.830245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:02.830245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:02.860973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:02.862172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:02.923807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1048/2138] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:02.935000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:02.938740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:03.055108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1d369-307a-4138-8702-30e75602f37e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:03.059534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebaf6c-8e78-42d7-8e67-b81fda12fc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:03.060176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebaf6c-8e78-42d7-8e67-b81fda12fc2d service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.060455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebaf6c-8e78-42d7-8e67-b81fda12fc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.060729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebaf6c-8e78-42d7-8e67-b81fda12fc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.069918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebaf6c-8e78-42d7-8e67-b81fda12fc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:03.071251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebaf6c-8e78-42d7-8e67-b81fda12fc2d service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:03.081381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1091/2139] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:03.615113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:03.616572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:03.629882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c9e2c-c13c-42b7-88e1-5e1123e53ed2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:03.637359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:03.638227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.638509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.638787 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] PATH_INFO: `/v3/projects/3113894e75dd4ac3ac156ccd21817a48` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.640481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3113894e75dd4ac3ac156ccd21817a48)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:03.642693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:03.773671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3113894e75dd4ac3ac156ccd21817a48', 'request_id': 'req-980cd311-87d5-46d8-9959-fba675b24f8b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:03.780482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3113894e75dd4ac3ac156ccd21817a48', 'request_id': 'req-980cd311-87d5-46d8-9959-fba675b24f8b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:03.851020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3113894e75dd4ac3ac156ccd21817a48', 'request_id': 'req-980cd311-87d5-46d8-9959-fba675b24f8b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:03.862895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] The token cache is being invalidate because project 3113894e75dd4ac3ac156ccd21817a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:03.863186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:03.863950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-980cd311-87d5-46d8-9959-fba675b24f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:03.865658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1049/2140] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:03 2022] DELETE /identity/v3/projects/3113894e75dd4ac3ac156ccd21817a48 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:03.871397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755bab7-8eee-4c7f-887b-e34cac43447c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.871957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755bab7-8eee-4c7f-887b-e34cac43447c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.872048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755bab7-8eee-4c7f-887b-e34cac43447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.902612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c755bab7-8eee-4c7f-887b-e34cac43447c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:03.903979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c755bab7-8eee-4c7f-887b-e34cac43447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:03.964302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1092/2141] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:03.973696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d4de9-9c59-4869-a4b3-7baad1efb779 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.974051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d4de9-9c59-4869-a4b3-7baad1efb779 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.974332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d4de9-9c59-4869-a4b3-7baad1efb779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.992897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-399d4de9-9c59-4869-a4b3-7baad1efb779 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:03.994473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-399d4de9-9c59-4869-a4b3-7baad1efb779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:04.002468 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1050/2142] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:04.006993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755bab7-8eee-4c7f-887b-e34cac43447c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.018895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755bab7-8eee-4c7f-887b-e34cac43447c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.024088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.024754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.025062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.025339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.026695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:04.027012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.028652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.040464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1093/2143] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:04.044980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d4de9-9c59-4869-a4b3-7baad1efb779 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.054332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d4de9-9c59-4869-a4b3-7baad1efb779 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.059091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.059762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.060049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.060322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.061003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.062913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.181512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1051/2144] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:04 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:04.186747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.196992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09172-f844-49c6-9015-4f6b94f7289f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.258824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.259418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.259739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.260023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.261282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.263334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.342668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1094/2145] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:04 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:04.347223 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.358211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146221d7-493c-4974-a6dd-b2bff06c2098 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.363000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.366829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.366829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.366829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.366829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.366829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.378203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1052/2146] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:04.382681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.393778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff507da-4f34-45b3-b347-42e427210d4d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.398918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6fd12-d9d7-4cd2-8879-57275fdeb731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.399447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6fd12-d9d7-4cd2-8879-57275fdeb731 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.399764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6fd12-d9d7-4cd2-8879-57275fdeb731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.400045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6fd12-d9d7-4cd2-8879-57275fdeb731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.400961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6fd12-d9d7-4cd2-8879-57275fdeb731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.402594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6fd12-d9d7-4cd2-8879-57275fdeb731 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.413164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1095/2147] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:04.417913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.427692 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd1fe-4aa3-4ab3-bf96-dbf626d2dcb3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.432951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.433789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.434221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.434507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] PATH_INFO: `/v3/projects/cf1e518d45164c459b5532eed76774ac/users/4e2df5a3de01493caa81910a56b3a40e/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.449949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1e518d45164c459b5532eed76774ac, user_id=4e2df5a3de01493caa81910a56b3a40e, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.452830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.514780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1053/2148] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:04 2022] PUT /identity/v3/projects/cf1e518d45164c459b5532eed76774ac/users/4e2df5a3de01493caa81910a56b3a40e/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:04.526354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e22a-cfc3-417f-b3cc-d643d487bf47 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.526901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e22a-cfc3-417f-b3cc-d643d487bf47 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.527344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e22a-cfc3-417f-b3cc-d643d487bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.554530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e973e22a-cfc3-417f-b3cc-d643d487bf47 None None] MFA Rules not processed for user `4e2df5a3de01493caa81910a56b3a40e`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:04.555869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e973e22a-cfc3-417f-b3cc-d643d487bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:04.624484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1096/2149] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:04.629070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.692302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202addb-1bb7-4102-aad9-b5b5eff1b125 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.697099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.698516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.698718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.698930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.699675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.701601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.852727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1054/2150] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:04 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:04.858285 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e22a-cfc3-417f-b3cc-d643d487bf47 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.869145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e22a-cfc3-417f-b3cc-d643d487bf47 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.926593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.927296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.927581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.927868 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.928558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.930496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.060424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1097/2151] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:04 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:05.064509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.074817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb916643-1e1a-4caa-8a06-00026b1a3d8e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.079283 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.079975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.080258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.080534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.081251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.082844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.094662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1055/2152] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:05.098773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.109691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb421f1-f1e8-4ab7-8105-63437735083a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.114217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd018ff-c38c-46b8-9a92-ed47df913e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.114875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd018ff-c38c-46b8-9a92-ed47df913e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.115160 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd018ff-c38c-46b8-9a92-ed47df913e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.115438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd018ff-c38c-46b8-9a92-ed47df913e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.116226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd018ff-c38c-46b8-9a92-ed47df913e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.117819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd018ff-c38c-46b8-9a92-ed47df913e40 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.127955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1098/2153] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:05.132125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.141961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0dfd-fa16-47c3-a238-92e8a71ea112 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.146525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.147425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.147751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.148026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] PATH_INFO: `/v3/projects/b24f304fa60c41e1a7195d156c97218f/users/fd521d03ecc3455199ee86e87571659e/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.164569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24f304fa60c41e1a7195d156c97218f, user_id=fd521d03ecc3455199ee86e87571659e, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.168008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.236911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1056/2154] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:05 2022] PUT /identity/v3/projects/b24f304fa60c41e1a7195d156c97218f/users/fd521d03ecc3455199ee86e87571659e/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:05.250628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82a57-e6bc-492c-b720-90d45fe8b97c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.250915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82a57-e6bc-492c-b720-90d45fe8b97c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.251216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82a57-e6bc-492c-b720-90d45fe8b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.278274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d7e82a57-e6bc-492c-b720-90d45fe8b97c None None] MFA Rules not processed for user `fd521d03ecc3455199ee86e87571659e`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:05.279684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d7e82a57-e6bc-492c-b720-90d45fe8b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:05.346106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1099/2155] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:05.350858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.412219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e425d-8bf0-405f-9385-440327d70735 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.417411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.418114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.418398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.418676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.419363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.421311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.538176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1057/2156] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:05 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:05.542196 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82a57-e6bc-492c-b720-90d45fe8b97c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.557302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82a57-e6bc-492c-b720-90d45fe8b97c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.615956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.616632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.616917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.617193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.617909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.620005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.726801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1100/2157] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:05 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:05.730824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.744482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79f226-2272-4ff9-a486-332c00f5e902 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.751799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.753027 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.753199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.753541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.754230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.756037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.769238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1058/2158] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:05.773442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.785178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d60f7b-26ac-4945-b93b-0d303b0a4e9c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.789967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.790910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.791197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.791537 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] PATH_INFO: `/v3/projects/bbda173d204a4d78997e4f236a4c0990/users/68c5f5c018394995a6a7c44e8005754f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.808351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbda173d204a4d78997e4f236a4c0990, user_id=68c5f5c018394995a6a7c44e8005754f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.811081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:05.920799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1101/2159] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:05 2022] PUT /identity/v3/projects/bbda173d204a4d78997e4f236a4c0990/users/68c5f5c018394995a6a7c44e8005754f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:05.925004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:05.936814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ec3f-8233-4d85-acb4-eea8f9b38032 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:05.995057 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daa221-44e2-4f16-ac8d-20e8bb9de23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:05.995765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daa221-44e2-4f16-ac8d-20e8bb9de23c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:05.996058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daa221-44e2-4f16-ac8d-20e8bb9de23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:05.996336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daa221-44e2-4f16-ac8d-20e8bb9de23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:05.997063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daa221-44e2-4f16-ac8d-20e8bb9de23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:05.998680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daa221-44e2-4f16-ac8d-20e8bb9de23c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:06.013313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1059/2160] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:06.016219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:06.027610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a9c0-9ce8-4e47-9d0c-acf820ae5fd9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:06.032663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:06.033620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:06.033974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:06.034314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] PATH_INFO: `/v3/projects/bbda173d204a4d78997e4f236a4c0990/users/68c5f5c018394995a6a7c44e8005754f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:06.036419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbda173d204a4d78997e4f236a4c0990, user_id=68c5f5c018394995a6a7c44e8005754f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:06.039241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:06.051248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1102/2161] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:06 2022] PUT /identity/v3/projects/bbda173d204a4d78997e4f236a4c0990/users/68c5f5c018394995a6a7c44e8005754f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:06.062475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:06.062768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:06.063050 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:06.091434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] MFA Rules not processed for user `68c5f5c018394995a6a7c44e8005754f`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:06.092908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:06.166923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1060/2162] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:06.178463 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:06.180230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:06.259133 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bce67-887d-4897-8bd4-897fb10ca493 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:06.263102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:06.263847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:06.264091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:06.264337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:06.321649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:06.323729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:06.334388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1103/2163] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:07.263439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:07.265524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:07.280261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c51e4d-21a2-4488-90ff-741d65543feb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:07.282981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c4e3a-7680-47bf-9754-142392a634d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:07.283665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4e3a-7680-47bf-9754-142392a634d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:07.284150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4e3a-7680-47bf-9754-142392a634d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:07.284427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4e3a-7680-47bf-9754-142392a634d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:07.289464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cf6c4e3a-7680-47bf-9754-142392a634d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:07.356578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c4e3a-7680-47bf-9754-142392a634d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:07.358016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c4e3a-7680-47bf-9754-142392a634d4 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:07.372188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1061/2164] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:07.911781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:07.913184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:08.001471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c0281-08d8-4ddd-9f9b-e3e63b19b3ef service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.006231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.007103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.007456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.007747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] PATH_INFO: `/v3/users/bbe002025e5e47bcbcf365ffcb0fa0fb` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.008942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe002025e5e47bcbcf365ffcb0fa0fb)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.011427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:08.204858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe002025e5e47bcbcf365ffcb0fa0fb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:08.205504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe002025e5e47bcbcf365ffcb0fa0fb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:08.270469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe002025e5e47bcbcf365ffcb0fa0fb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:08.278125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe002025e5e47bcbcf365ffcb0fa0fb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:08.278866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe002025e5e47bcbcf365ffcb0fa0fb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:08.296159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1104/2165] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:07 2022] DELETE /identity/v3/users/bbe002025e5e47bcbcf365ffcb0fa0fb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:08.301476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.301987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.302086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.319802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:08.321022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:08.379988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1062/2166] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:08.389678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:08.391045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:08.446599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6c71-4714-4859-a483-9f8d915150c4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.450772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.451411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.451719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.451990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.461310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.462817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:08.473279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1105/2167] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:08.880807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:08.882317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:08.896002 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bf693-562a-4145-916d-a86a8e0c100e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.901835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.902899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.903186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.903485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] PATH_INFO: `/v3/projects/fd1d3e5710664e75ac8d9514956450c1` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.904815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1d3e5710664e75ac8d9514956450c1)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.906888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:09.043821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1d3e5710664e75ac8d9514956450c1', 'request_id': 'req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.050305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1d3e5710664e75ac8d9514956450c1', 'request_id': 'req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.122087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1d3e5710664e75ac8d9514956450c1', 'request_id': 'req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.132993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] The token cache is being invalidate because project fd1d3e5710664e75ac8d9514956450c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:09.133216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.133838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.135392 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1063/2168] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:08 2022] DELETE /identity/v3/projects/fd1d3e5710664e75ac8d9514956450c1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:09.139438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:09.149825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94312c6c-9756-4ff5-a148-8a6b6a4ff37a service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:09.208561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:09.209443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:09.209728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:09.210001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] PATH_INFO: `/v3/users/c02ad90418b544ebab723cb6e73edfe7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:09.211213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02ad90418b544ebab723cb6e73edfe7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:09.213891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:09.407254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02ad90418b544ebab723cb6e73edfe7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.407866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02ad90418b544ebab723cb6e73edfe7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.485140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02ad90418b544ebab723cb6e73edfe7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.492619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02ad90418b544ebab723cb6e73edfe7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.493292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-35f1b99b-8d8c-41bb-82a3-200bcfcf6880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02ad90418b544ebab723cb6e73edfe7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:09.510988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1106/2169] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:09 2022] DELETE /identity/v3/users/c02ad90418b544ebab723cb6e73edfe7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:09.929688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:09.931682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:09.948708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3f485-501b-416c-86f1-d0e0fe8bc0e3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.006235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.007113 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.007401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.007716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] PATH_INFO: `/v3/projects/88f4a9c96d6c46d08c4635a626441e86` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.008951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f4a9c96d6c46d08c4635a626441e86)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.011000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.133965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f4a9c96d6c46d08c4635a626441e86', 'request_id': 'req-7137eedc-6597-43ad-b06d-b59ff8e10904'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:10.140217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f4a9c96d6c46d08c4635a626441e86', 'request_id': 'req-7137eedc-6597-43ad-b06d-b59ff8e10904'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:10.236235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f4a9c96d6c46d08c4635a626441e86', 'request_id': 'req-7137eedc-6597-43ad-b06d-b59ff8e10904'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:10.247675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] The token cache is being invalidate because project 88f4a9c96d6c46d08c4635a626441e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:10.247963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:10.248612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7137eedc-6597-43ad-b06d-b59ff8e10904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:10.250247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1064/2170] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:09 2022] DELETE /identity/v3/projects/88f4a9c96d6c46d08c4635a626441e86 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:10.256278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c18-a856-47d0-a8b4-4c934a08785e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.256903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c18-a856-47d0-a8b4-4c934a08785e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.256903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c18-a856-47d0-a8b4-4c934a08785e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.284733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bcaa2c18-a856-47d0-a8b4-4c934a08785e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:10.285964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bcaa2c18-a856-47d0-a8b4-4c934a08785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:10.345046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1107/2171] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:10.353333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a77cf0-5c55-4d2f-97b5-fa427eee5d8c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.353624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a77cf0-5c55-4d2f-97b5-fa427eee5d8c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.354475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a77cf0-5c55-4d2f-97b5-fa427eee5d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.375055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-02a77cf0-5c55-4d2f-97b5-fa427eee5d8c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:10.376124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-02a77cf0-5c55-4d2f-97b5-fa427eee5d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:10.388976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1065/2172] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:10.389989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c18-a856-47d0-a8b4-4c934a08785e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:10.404360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c18-a856-47d0-a8b4-4c934a08785e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.410945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.410945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.410945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.410945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.411312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:10.411312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.411312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.428478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1108/2173] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:10.432654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a77cf0-5c55-4d2f-97b5-fa427eee5d8c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:10.442736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a77cf0-5c55-4d2f-97b5-fa427eee5d8c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.448388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.449056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.449334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.449722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.450414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.452414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.558721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1066/2174] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:10 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:10.563131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:10.574254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994408-aa42-4ee9-adab-fedb81d9766a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.629310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.629981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.630266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.630732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.631252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.633253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.734548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1109/2175] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:10 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:10.742592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:10.761979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8b6ac-28e2-435e-8ce5-e21b58f80451 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.761979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.761979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.761979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.762949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.762949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.763106 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.774426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1067/2176] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:10.778911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:10.789762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809327-0909-47fd-8b76-cee0a05927b5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.794708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.795638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.795940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.796238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.796956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.798569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.812731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1110/2177] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:10.815421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:10.820469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:10.822179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:10.826473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402b239-7b8d-4540-8a61-e933e351dc7d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.831206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73b0a-b938-4998-b836-700ba6a79e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.832132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73b0a-b938-4998-b836-700ba6a79e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.832427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73b0a-b938-4998-b836-700ba6a79e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.832696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73b0a-b938-4998-b836-700ba6a79e69 admin admin] PATH_INFO: `/v3/projects/b7f31f812b3f43ec9375a5a73c403a79/users/660e9bf80a0c41a98e48c43ca6076a78/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.847947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c73b0a-b938-4998-b836-700ba6a79e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f31f812b3f43ec9375a5a73c403a79, user_id=660e9bf80a0c41a98e48c43ca6076a78, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.850604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c73b0a-b938-4998-b836-700ba6a79e69 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.881127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7636d-da11-4c10-9426-c1165cd82647 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:10.885581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:10.886231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.886516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.886793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.888764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:10.936762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1068/2178] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:10 2022] PUT /identity/v3/projects/b7f31f812b3f43ec9375a5a73c403a79/users/660e9bf80a0c41a98e48c43ca6076a78/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:10.948893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9053-3e07-4c5b-a3e8-0f58a2e22a2e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:10.949252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9053-3e07-4c5b-a3e8-0f58a2e22a2e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:10.949612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9053-3e07-4c5b-a3e8-0f58a2e22a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:10.953448 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:10.954895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:10.964502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1111/2179] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:10.977271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6b4a9053-3e07-4c5b-a3e8-0f58a2e22a2e None None] MFA Rules not processed for user `660e9bf80a0c41a98e48c43ca6076a78`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:10.978486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6b4a9053-3e07-4c5b-a3e8-0f58a2e22a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:11.044430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1069/2180] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:11.053323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:11.064907 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c9a0e-21b8-42e0-8938-257f7ad13c0e service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:11.125640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:11.126884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.126884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.127111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.127915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:11.129968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:11.278351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1112/2181] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:11 2022] POST /identity/v3/projects => generated 381 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:11.282139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a9053-3e07-4c5b-a3e8-0f58a2e22a2e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:11.294294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a9053-3e07-4c5b-a3e8-0f58a2e22a2e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:11.353132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:11.354006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.354302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.354579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.355277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:11.357337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:11.486310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1070/2182] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:11 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:11.487687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:11.498789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b75d77-40dc-4af8-aafe-f80f1e2e05a1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:11.504405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:11.505073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.505392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.505752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.506707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:11.508433 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:11.519078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1113/2183] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:11.523355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:11.533497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797818e-7a0c-4d39-91f1-fb68fe0f5d90 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:11.538051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:11.538923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.539208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.539514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] PATH_INFO: `/v3/projects/7632ffa06cf84e1bb99003e62a2d5f9a/users/8d4746cefe3d4c6799a549382ec56806/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.555767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7632ffa06cf84e1bb99003e62a2d5f9a, user_id=8d4746cefe3d4c6799a549382ec56806, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:11.559061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:11.642614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1071/2184] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:11 2022] PUT /identity/v3/projects/7632ffa06cf84e1bb99003e62a2d5f9a/users/8d4746cefe3d4c6799a549382ec56806/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:11.647338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:11.661581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a80d1c-376e-4750-a0aa-fb3078a73d2c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:11.741362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750bba-77b4-4ddc-893b-8eba2ba71342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:11.742121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750bba-77b4-4ddc-893b-8eba2ba71342 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.742401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750bba-77b4-4ddc-893b-8eba2ba71342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.742680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750bba-77b4-4ddc-893b-8eba2ba71342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.743435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750bba-77b4-4ddc-893b-8eba2ba71342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:11.745778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750bba-77b4-4ddc-893b-8eba2ba71342 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:11.765592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1114/2185] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:32:11.766574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:11.777476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7b61-f30c-457f-abc6-48366153f4a7 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:11.782323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:11.783201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.784070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.784297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] PATH_INFO: `/v3/projects/7632ffa06cf84e1bb99003e62a2d5f9a/users/8d4746cefe3d4c6799a549382ec56806/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.786386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7632ffa06cf84e1bb99003e62a2d5f9a, user_id=8d4746cefe3d4c6799a549382ec56806, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:11.789119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:11.800732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1072/2186] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:11 2022] PUT /identity/v3/projects/7632ffa06cf84e1bb99003e62a2d5f9a/users/8d4746cefe3d4c6799a549382ec56806/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:11.811401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77ea9a-1335-4163-adaa-2a2c20802206 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.811717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77ea9a-1335-4163-adaa-2a2c20802206 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.812073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77ea9a-1335-4163-adaa-2a2c20802206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.841748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ab77ea9a-1335-4163-adaa-2a2c20802206 None None] MFA Rules not processed for user `8d4746cefe3d4c6799a549382ec56806`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:11.842985 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ab77ea9a-1335-4163-adaa-2a2c20802206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:11.919801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1115/2187] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:12.042788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:12.045087 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:12.106544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e4e04-5622-4b04-a31d-2727a483308c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:12.110168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:12.110813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:12.111102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:12.111384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:12.120396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:12.121813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:12.131427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1073/2188] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:13.006360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77ea9a-1335-4163-adaa-2a2c20802206 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:13.018432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77ea9a-1335-4163-adaa-2a2c20802206 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:13.024613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef28219-1a89-4050-a53d-9e980aa0a7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:13.025360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef28219-1a89-4050-a53d-9e980aa0a7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.025741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef28219-1a89-4050-a53d-9e980aa0a7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.026129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef28219-1a89-4050-a53d-9e980aa0a7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.029105 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5ef28219-1a89-4050-a53d-9e980aa0a7c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:13.112292 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef28219-1a89-4050-a53d-9e980aa0a7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:13.113743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef28219-1a89-4050-a53d-9e980aa0a7c4 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.124814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1116/2189] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:13.221991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:13.289134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ed4f-0f40-4610-9a62-b5015895f807 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:13.293946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:13.294810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.295097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.295371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] PATH_INFO: `/v3/users/660e9bf80a0c41a98e48c43ca6076a78` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.296612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=660e9bf80a0c41a98e48c43ca6076a78)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:13.298531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.554393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660e9bf80a0c41a98e48c43ca6076a78'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:13.563566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660e9bf80a0c41a98e48c43ca6076a78'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:13.644704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660e9bf80a0c41a98e48c43ca6076a78'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:13.656779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660e9bf80a0c41a98e48c43ca6076a78'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:13.657427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660e9bf80a0c41a98e48c43ca6076a78'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:13.663486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1074/2190] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:13 2022] DELETE /identity/v3/users/660e9bf80a0c41a98e48c43ca6076a78 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:13.667972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.668263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.668543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.687566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:13.688893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:13.753442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1117/2191] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:13.763384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:13.765097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:13.835766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe658-6e1f-4084-9485-186c2414ab1b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:13.840256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:13.841872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.841872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.841872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.852431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:13.853911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.864372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1075/2192] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:14.366241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:14.368172 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:14.385855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583184d-ca14-44ab-8a1d-30c775d9dd6c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:14.390553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:14.392711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:14.392711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:14.392711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] PATH_INFO: `/v3/projects/b7f31f812b3f43ec9375a5a73c403a79` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:14.393336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f31f812b3f43ec9375a5a73c403a79)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:14.395230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:14.526051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f31f812b3f43ec9375a5a73c403a79', 'request_id': 'req-83b7142a-0ad6-481e-88c1-bb793c21efc7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:14.532864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f31f812b3f43ec9375a5a73c403a79', 'request_id': 'req-83b7142a-0ad6-481e-88c1-bb793c21efc7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:14.610842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f31f812b3f43ec9375a5a73c403a79', 'request_id': 'req-83b7142a-0ad6-481e-88c1-bb793c21efc7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:14.628781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] The token cache is being invalidate because project b7f31f812b3f43ec9375a5a73c403a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:14.629080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:14.629766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:14.631340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1118/2193] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:14 2022] DELETE /identity/v3/projects/b7f31f812b3f43ec9375a5a73c403a79 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:14.635754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:14.645691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a5e6b-fe32-4de3-8711-1eb393566170 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:14.709934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:14.710843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:14.711134 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:14.711416 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] PATH_INFO: `/v3/users/8d4746cefe3d4c6799a549382ec56806` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:14.712672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4746cefe3d4c6799a549382ec56806)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:14.714713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:14.993607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4746cefe3d4c6799a549382ec56806'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.000639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4746cefe3d4c6799a549382ec56806'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.113940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4746cefe3d4c6799a549382ec56806'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.127200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4746cefe3d4c6799a549382ec56806'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.127946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-48f70394-4742-437e-89a9-fb9cb0166a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4746cefe3d4c6799a549382ec56806'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.134041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1076/2194] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:14 2022] DELETE /identity/v3/users/8d4746cefe3d4c6799a549382ec56806 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:15.589620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:15.591179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:15.604509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7142a-0ad6-481e-88c1-bb793c21efc7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:15.680407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:15.681507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:15.682374 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:15.684675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] PATH_INFO: `/v3/projects/7632ffa06cf84e1bb99003e62a2d5f9a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:15.684675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7632ffa06cf84e1bb99003e62a2d5f9a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:15.686049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:15.802745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7632ffa06cf84e1bb99003e62a2d5f9a', 'request_id': 'req-610ec805-2c95-4c70-a112-ff12ddd90c32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.809493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7632ffa06cf84e1bb99003e62a2d5f9a', 'request_id': 'req-610ec805-2c95-4c70-a112-ff12ddd90c32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.917028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7632ffa06cf84e1bb99003e62a2d5f9a', 'request_id': 'req-610ec805-2c95-4c70-a112-ff12ddd90c32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.929408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] The token cache is being invalidate because project 7632ffa06cf84e1bb99003e62a2d5f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:15.929789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.930481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-610ec805-2c95-4c70-a112-ff12ddd90c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:15.932600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1119/2195] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:15 2022] DELETE /identity/v3/projects/7632ffa06cf84e1bb99003e62a2d5f9a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:15.937725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83883680-1b53-4499-a0a6-771904330646 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:15.938192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83883680-1b53-4499-a0a6-771904330646 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:15.938272 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83883680-1b53-4499-a0a6-771904330646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:15.957213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-83883680-1b53-4499-a0a6-771904330646 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:15.958420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-83883680-1b53-4499-a0a6-771904330646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:16.022124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1077/2196] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:16.029168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dced-9bdd-484d-b972-a0f1e30f4482 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.029458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dced-9bdd-484d-b972-a0f1e30f4482 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.029743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dced-9bdd-484d-b972-a0f1e30f4482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.049595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e395dced-9bdd-484d-b972-a0f1e30f4482 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:16.050842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e395dced-9bdd-484d-b972-a0f1e30f4482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:16.059639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1120/2197] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:16.064235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83883680-1b53-4499-a0a6-771904330646 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.074261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83883680-1b53-4499-a0a6-771904330646 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.078981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.079669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.079960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.080242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.080978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:16.081290 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.082891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.101155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1078/2198] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:16.105963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395dced-9bdd-484d-b972-a0f1e30f4482 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.115420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395dced-9bdd-484d-b972-a0f1e30f4482 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.121044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.121648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.121942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.122214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.126999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.126999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.277753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1121/2199] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:16 2022] POST /identity/v3/projects => generated 359 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:16.282004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.292390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed8f3-0a81-4646-a177-e05f5cba507b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.353559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.354877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.355164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.355446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.356179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.358167 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.428234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.430054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:16.442891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ac587-2f00-42e5-9814-6041c8ff12c1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.455528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.455528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.455528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.455528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] PATH_INFO: `/v3/users/0a8bc131b3ba4ed0a310d49eecdec273` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.455904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8bc131b3ba4ed0a310d49eecdec273)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.455904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.508776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1079/2200] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:16 2022] POST /identity/v3/users => generated 280 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:16.513195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.522917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b0597-09f2-4a19-ae63-525d833a8208 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.528052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.528707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.529000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.529281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.530011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.531634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.542125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1080/2201] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:32:16.546163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.555758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c73f-4cad-41f8-acb7-1ce7e9450a30 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.560560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.561219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.561507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.561789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.562784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.564573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.574931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1081/2202] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:32:16.579024 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.589595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94c61e-3b7d-4c8b-b6f1-ca11c2619f76 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.594790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ca413-c0bd-49ae-83c1-f546da18d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.595717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca413-c0bd-49ae-83c1-f546da18d0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.596000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca413-c0bd-49ae-83c1-f546da18d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.596275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca413-c0bd-49ae-83c1-f546da18d0f3 admin admin] PATH_INFO: `/v3/projects/7177eb3cba7641bfbfd4c32cb9cf01be/users/35212b42b9384cfbaaf8d8bc42110733/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.612578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca413-c0bd-49ae-83c1-f546da18d0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7177eb3cba7641bfbfd4c32cb9cf01be, user_id=35212b42b9384cfbaaf8d8bc42110733, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.615428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca413-c0bd-49ae-83c1-f546da18d0f3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.712513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1082/2203] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:16 2022] PUT /identity/v3/projects/7177eb3cba7641bfbfd4c32cb9cf01be/users/35212b42b9384cfbaaf8d8bc42110733/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:16.733414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.733969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.734497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.780228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] MFA Rules not processed for user `35212b42b9384cfbaaf8d8bc42110733`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:16.781734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:16.808025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8bc131b3ba4ed0a310d49eecdec273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:16.808889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8bc131b3ba4ed0a310d49eecdec273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:16.851195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1083/2204] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:16.884071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.885912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:16.905017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8bc131b3ba4ed0a310d49eecdec273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:16.913167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8bc131b3ba4ed0a310d49eecdec273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:16.914148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-27dc0308-f850-4b86-b131-950c843abb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8bc131b3ba4ed0a310d49eecdec273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:16.933132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1122/2205] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:16 2022] DELETE /identity/v3/users/0a8bc131b3ba4ed0a310d49eecdec273 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:16.937461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.937993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.938275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.948722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c12b1-49c7-4b5c-89da-a0f11a267ae2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.957633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:16.958801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:16.998177 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.998836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.999174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.999455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.001330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:17.040258 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1123/2206] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:17.049926 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.051485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:17.065637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.067105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.079424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1084/2207] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:17.092168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.093711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:17.107974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c895-3bb7-48fb-b2c5-f39f0442e29f service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.112900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.113704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876c447-d6bd-4d53-97f3-8c289158d57a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.113828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.114050 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.114326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] PATH_INFO: `/v3/users/35212b42b9384cfbaaf8d8bc42110733` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.115568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=35212b42b9384cfbaaf8d8bc42110733)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.117629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.120153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50b16b-f6ad-4086-bf56-8ec881b182dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.120819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b16b-f6ad-4086-bf56-8ec881b182dd service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.121148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b16b-f6ad-4086-bf56-8ec881b182dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.121423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b16b-f6ad-4086-bf56-8ec881b182dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.139752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50b16b-f6ad-4086-bf56-8ec881b182dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.141266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50b16b-f6ad-4086-bf56-8ec881b182dd service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.151986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1124/2208] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:17.400815 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35212b42b9384cfbaaf8d8bc42110733'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.406400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35212b42b9384cfbaaf8d8bc42110733'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.530372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35212b42b9384cfbaaf8d8bc42110733'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.545150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35212b42b9384cfbaaf8d8bc42110733'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.545391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35212b42b9384cfbaaf8d8bc42110733'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.553244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1085/2209] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:17 2022] DELETE /identity/v3/users/35212b42b9384cfbaaf8d8bc42110733 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:17.560275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.560561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.560955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.578667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:17.580245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:17.653325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1125/2210] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:17.663574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.665064 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:17.682077 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.684744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:17.701545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2013a-d93b-482f-ab00-a3f994fd5ba2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.706658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.707810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.708255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.708684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] PATH_INFO: `/v3/projects/caa6faf95a264a2cb4961f50442e178f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.710322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa6faf95a264a2cb4961f50442e178f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.715283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.774102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41c910-1b37-47fc-8ec2-7099652ed13f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.778923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.779652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.779937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.780255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.789405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.790882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.800810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1086/2211] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:17.903408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa6faf95a264a2cb4961f50442e178f', 'request_id': 'req-57b059a1-1797-4932-b8eb-92856759a21f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.913041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa6faf95a264a2cb4961f50442e178f', 'request_id': 'req-57b059a1-1797-4932-b8eb-92856759a21f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.982355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa6faf95a264a2cb4961f50442e178f', 'request_id': 'req-57b059a1-1797-4932-b8eb-92856759a21f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.995274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] The token cache is being invalidate because project caa6faf95a264a2cb4961f50442e178f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:17.995685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.996431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:17.998336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1126/2212] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:17 2022] DELETE /identity/v3/projects/caa6faf95a264a2cb4961f50442e178f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:18.002996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:18.015000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14898de5-fb5b-4b73-a2e0-2d78e009e01c service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:18.079654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:18.080561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:18.080847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:18.081128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] PATH_INFO: `/v3/users/ef2121d2a539468aad89b90cf4e6cbd1` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:18.082372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2121d2a539468aad89b90cf4e6cbd1)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:18.084354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:18.414437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2121d2a539468aad89b90cf4e6cbd1'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.422930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2121d2a539468aad89b90cf4e6cbd1'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.561469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:18.562911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:18.578883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b059a1-1797-4932-b8eb-92856759a21f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:18.590815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:18.592062 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:18.592418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:18.592753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] PATH_INFO: `/v3/users/4e2df5a3de01493caa81910a56b3a40e` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:18.594508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2df5a3de01493caa81910a56b3a40e)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:18.597588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2121d2a539468aad89b90cf4e6cbd1'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.598404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:18.619994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2121d2a539468aad89b90cf4e6cbd1'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.628377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2121d2a539468aad89b90cf4e6cbd1'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.646913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1087/2213] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:18 2022] DELETE /identity/v3/users/ef2121d2a539468aad89b90cf4e6cbd1 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:18.646913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:18.646913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:18.732945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cb8b2-5ce3-46e6-a2a1-9fc1974a57bc admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:18.744428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:18.746098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:18.746550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:18.746836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] PATH_INFO: `/v3/projects/7177eb3cba7641bfbfd4c32cb9cf01be` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:18.748546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7177eb3cba7641bfbfd4c32cb9cf01be)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:18.753222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:18.929600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2df5a3de01493caa81910a56b3a40e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.930820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7177eb3cba7641bfbfd4c32cb9cf01be', 'request_id': 'req-f20487e0-9a84-403d-bf57-27263cba24d8'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.931308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2df5a3de01493caa81910a56b3a40e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:18.938362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7177eb3cba7641bfbfd4c32cb9cf01be', 'request_id': 'req-f20487e0-9a84-403d-bf57-27263cba24d8'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.016307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2df5a3de01493caa81910a56b3a40e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.025293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2df5a3de01493caa81910a56b3a40e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.026636 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2df5a3de01493caa81910a56b3a40e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.046776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1127/2214] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:18 2022] DELETE /identity/v3/users/4e2df5a3de01493caa81910a56b3a40e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:19.050525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.050525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.067253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7177eb3cba7641bfbfd4c32cb9cf01be', 'request_id': 'req-f20487e0-9a84-403d-bf57-27263cba24d8'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.079636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] The token cache is being invalidate because project 7177eb3cba7641bfbfd4c32cb9cf01be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:19.081917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.081917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f20487e0-9a84-403d-bf57-27263cba24d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.086999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1088/2215] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:18 2022] DELETE /identity/v3/projects/7177eb3cba7641bfbfd4c32cb9cf01be => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:19.086999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f69f1-02fb-40ea-8310-0d3f934a6c4f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.086999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f69f1-02fb-40ea-8310-0d3f934a6c4f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.086999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f69f1-02fb-40ea-8310-0d3f934a6c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.106869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ad6f69f1-02fb-40ea-8310-0d3f934a6c4f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:19.108519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ad6f69f1-02fb-40ea-8310-0d3f934a6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.129794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aa59e-f4c8-4c2c-8ce2-ac462691e4a6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:19.136533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:19.137492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.137782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.138750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] PATH_INFO: `/v3/users/7b5c9dfd8c66444b9394dc086728a159` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.140161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5c9dfd8c66444b9394dc086728a159)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:19.142347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:19.203846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1089/2216] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:19.205517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.205827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.206193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.227053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:19.230769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.239868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1090/2217] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:19.240823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.242262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.322612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f621d-4f9d-4b8a-aee2-aa237f422f1e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:19.326675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2076-c38f-4bf5-bdfb-6e7027fcf667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:19.327505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2076-c38f-4bf5-bdfb-6e7027fcf667 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.328440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2076-c38f-4bf5-bdfb-6e7027fcf667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.328845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2076-c38f-4bf5-bdfb-6e7027fcf667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.340563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2076-c38f-4bf5-bdfb-6e7027fcf667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:19.342178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2076-c38f-4bf5-bdfb-6e7027fcf667 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:19.360166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1091/2218] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:19.361588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111a9f-f4cb-4b50-ab06-1bbd23cc9bcb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.361877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111a9f-f4cb-4b50-ab06-1bbd23cc9bcb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.362242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111a9f-f4cb-4b50-ab06-1bbd23cc9bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.393399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8c111a9f-f4cb-4b50-ab06-1bbd23cc9bcb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:19.395945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8c111a9f-f4cb-4b50-ab06-1bbd23cc9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.401776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5c9dfd8c66444b9394dc086728a159'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.407442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5c9dfd8c66444b9394dc086728a159'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.407858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1092/2219] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:19.411756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111a9f-f4cb-4b50-ab06-1bbd23cc9bcb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.421313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111a9f-f4cb-4b50-ab06-1bbd23cc9bcb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:19.426226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:19.426897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.427166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.427443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.428234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:19.428540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:19.430319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:19.445860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1093/2220] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:19.446793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.456917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08256-170e-4c06-9b6f-38cb5aeddff1 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:19.467654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce01ce-4731-424c-984b-720a69e959a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:19.467654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce01ce-4731-424c-984b-720a69e959a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.467654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce01ce-4731-424c-984b-720a69e959a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.467654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce01ce-4731-424c-984b-720a69e959a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.467995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce01ce-4731-424c-984b-720a69e959a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:19.468473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce01ce-4731-424c-984b-720a69e959a0 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:19.493714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5c9dfd8c66444b9394dc086728a159'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.503989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5c9dfd8c66444b9394dc086728a159'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.504739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5c9dfd8c66444b9394dc086728a159'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.530187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1128/2221] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:19 2022] DELETE /identity/v3/users/7b5c9dfd8c66444b9394dc086728a159 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:19.531108 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.532488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.605319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1094/2222] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:19 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:19.605319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.605319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.605319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.615789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78214f-de86-49f4-9cd4-eecf0a5e0b0b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:19.635124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:19.637359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.676929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:19.678217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.678609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.680398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] PATH_INFO: `/v3/projects/cad415b712fa43c8902fdb956ec86343` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.681088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad415b712fa43c8902fdb956ec86343)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:19.683770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:19.721367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1095/2223] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:19.722881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.726427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.744749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84449f65-82ed-4c75-9fbf-8ccd1a6c3fe2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:19.751577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:19.757353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:19.757353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:19.757353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:19.757353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:19.757353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:19.818150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad415b712fa43c8902fdb956ec86343', 'request_id': 'req-d453d67b-2a25-440c-b321-de190282dfde'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.832259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad415b712fa43c8902fdb956ec86343', 'request_id': 'req-d453d67b-2a25-440c-b321-de190282dfde'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.878310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1096/2224] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:19 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:19.878310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.880248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.913700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad415b712fa43c8902fdb956ec86343', 'request_id': 'req-d453d67b-2a25-440c-b321-de190282dfde'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.925493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] The token cache is being invalidate because project cad415b712fa43c8902fdb956ec86343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:19.925790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.927090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:19.928916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1129/2225] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:19 2022] DELETE /identity/v3/projects/cad415b712fa43c8902fdb956ec86343 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:19.930022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:19.931644 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:19.945140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf882a2-407f-4290-abee-e6a1a85a3780 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.009386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d67b-2a25-440c-b321-de190282dfde admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.011102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.011841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.012131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.012414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.014241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.015686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.016642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.017001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.017343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] PATH_INFO: `/v3/users/c24559a2a560455e9f6e213cb75a02f8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.018714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24559a2a560455e9f6e213cb75a02f8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.021057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.034338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.036975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.053055 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1097/2226] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:20.054285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.056429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.076528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf995-24f9-4dfa-a57d-b9334591da46 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.084741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33264325-696d-4b65-aba7-8d91417a2db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.085423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33264325-696d-4b65-aba7-8d91417a2db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.085715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33264325-696d-4b65-aba7-8d91417a2db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.086022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33264325-696d-4b65-aba7-8d91417a2db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.086788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33264325-696d-4b65-aba7-8d91417a2db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.088635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33264325-696d-4b65-aba7-8d91417a2db1 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.099404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1098/2227] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:20.100743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.101033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.101315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.122215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:20.123461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.133540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1099/2228] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:20.134477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.137143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.149306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebddc9-7f93-4de8-b9d7-2d41b5389ce0 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.154444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.156698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.156698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.156698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] PATH_INFO: `/v3/projects/cf1e518d45164c459b5532eed76774ac` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.157527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1e518d45164c459b5532eed76774ac)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.159753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.267561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24559a2a560455e9f6e213cb75a02f8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.268212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24559a2a560455e9f6e213cb75a02f8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.294767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1e518d45164c459b5532eed76774ac', 'request_id': 'req-8ce1b660-d5c8-4bae-89e4-3b465a749d74'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.301412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1e518d45164c459b5532eed76774ac', 'request_id': 'req-8ce1b660-d5c8-4bae-89e4-3b465a749d74'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.362881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24559a2a560455e9f6e213cb75a02f8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.371855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24559a2a560455e9f6e213cb75a02f8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.373026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24559a2a560455e9f6e213cb75a02f8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.401327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1130/2229] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:19 2022] DELETE /identity/v3/users/c24559a2a560455e9f6e213cb75a02f8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:20.401327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.401327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.420835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1e518d45164c459b5532eed76774ac', 'request_id': 'req-8ce1b660-d5c8-4bae-89e4-3b465a749d74'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.449254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] The token cache is being invalidate because project cf1e518d45164c459b5532eed76774ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:20.450091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.451328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8ce1b660-d5c8-4bae-89e4-3b465a749d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.456114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1100/2230] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:20 2022] DELETE /identity/v3/projects/cf1e518d45164c459b5532eed76774ac => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:20.458528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.459111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.460917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.508071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:20.509506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.520223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104c8ed-a6f5-4dbc-a283-8ff2937bf3af admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.525413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.526348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.528136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.528136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.528136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.528398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1101/2231] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:20.529309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.532691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.533263 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.547555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15b38-cf2c-4a35-9d0b-abe1cd4c7306 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.553024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1131/2232] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:20.555173 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.558072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.559344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.562575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.562575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] PATH_INFO: `/v3/users/fd521d03ecc3455199ee86e87571659e` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.562575 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd521d03ecc3455199ee86e87571659e)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.566355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.568321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24aaf5-b320-4995-8cb7-7c833a537cc5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.575015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.576437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.576939 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.577403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.578499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:20.579061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.581301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.604921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1132/2233] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:20.606703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.610297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.624029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483923d-7e8d-4aab-984c-fb7dc81688e5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.628804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.629703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.629992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.630274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] PATH_INFO: `/v3/projects/4eb5683e461644a9965b517b46804c63/users/51d90075e9d546d98ea11e2f1dd7002c/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.646408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb5683e461644a9965b517b46804c63, user_id=51d90075e9d546d98ea11e2f1dd7002c, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.649277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.749849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1133/2234] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:20 2022] PUT /identity/v3/projects/4eb5683e461644a9965b517b46804c63/users/51d90075e9d546d98ea11e2f1dd7002c/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:20.760594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.810028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd521d03ecc3455199ee86e87571659e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.818313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd521d03ecc3455199ee86e87571659e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.820452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197432b9-aabb-400f-b36b-6c4220b87e7e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:20.825959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:20.826776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.827065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.827342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.828068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:20.830002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:20.893614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd521d03ecc3455199ee86e87571659e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.907436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd521d03ecc3455199ee86e87571659e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.908154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd521d03ecc3455199ee86e87571659e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:20.914020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1102/2235] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:20 2022] DELETE /identity/v3/users/fd521d03ecc3455199ee86e87571659e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:20.914823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.916160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:20.930685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1134/2236] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:20 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:20.933009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:20.935092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.006949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9120-d7ea-453f-bd0e-18047dad7b23 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.012893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994168d8-5696-498c-a8f8-45a09782d00e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.014763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.015695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.016686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.016975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] PATH_INFO: `/v3/projects/94f2dce393564009b2689b67cc2f34ce` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.018049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.018280 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f2dce393564009b2689b67cc2f34ce)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.018945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.019388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.019737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] PATH_INFO: `/v3/projects/6a54aedaf3e54f678df5bff5faf44b12` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.020288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.021063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a54aedaf3e54f678df5bff5faf44b12)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.023814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.169669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f2dce393564009b2689b67cc2f34ce', 'request_id': 'req-02019da0-00f7-4308-aa1f-e2be806ed75d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.175870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f2dce393564009b2689b67cc2f34ce', 'request_id': 'req-02019da0-00f7-4308-aa1f-e2be806ed75d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.198075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a54aedaf3e54f678df5bff5faf44b12', 'request_id': 'req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.205234 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a54aedaf3e54f678df5bff5faf44b12', 'request_id': 'req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.256437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f2dce393564009b2689b67cc2f34ce', 'request_id': 'req-02019da0-00f7-4308-aa1f-e2be806ed75d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.267741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] The token cache is being invalidate because project 94f2dce393564009b2689b67cc2f34ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:21.268040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.268703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-02019da0-00f7-4308-aa1f-e2be806ed75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.270365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1135/2237] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:20 2022] DELETE /identity/v3/projects/94f2dce393564009b2689b67cc2f34ce => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:21.271640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.271946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.272210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.297943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] MFA Rules not processed for user `51d90075e9d546d98ea11e2f1dd7002c`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:21.299145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.356466 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a54aedaf3e54f678df5bff5faf44b12', 'request_id': 'req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.361769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1136/2238] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:21.362595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.364325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.373719 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] The token cache is being invalidate because project 6a54aedaf3e54f678df5bff5faf44b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:21.374026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.374734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.377969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1103/2239] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:20 2022] DELETE /identity/v3/projects/6a54aedaf3e54f678df5bff5faf44b12 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:21.378723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.383328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.456478 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6826-a66a-46dc-a2be-31a9cdc72181 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.465209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.466231 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.466931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.467311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.467989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426b6b4-33a2-44dc-bc27-aeac8a05ac03 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.468464 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.472741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.476759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.479803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.480308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.481011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] PATH_INFO: `/v3/users/0af3818e84e044d882d7bab32592f086` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.482656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af3818e84e044d882d7bab32592f086)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.484874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.619776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1137/2240] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:21 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:21.620735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.622294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.679027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c224e-4183-4ded-8c04-b96e4761efe5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.682741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.683827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.684121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.684403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.686357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.697779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.699221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.708772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1138/2241] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:21.712190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.712190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.725775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e94441-3a34-4e76-ae0c-8b427195042e service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.731308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.732013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.732302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.732582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.733354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.735085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.752530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1139/2242] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:21.752530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.769910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fb89b-fed0-4776-834e-d28ba83d0212 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.775128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.776565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.776809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.777141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.777970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.780550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.793902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af3818e84e044d882d7bab32592f086'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.798750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1140/2243] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:21.798750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.801405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.802641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af3818e84e044d882d7bab32592f086'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.816511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ff83d-d072-42c3-9590-0f650208800e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.821860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.822789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.823074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.823355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] PATH_INFO: `/v3/projects/b24f304fa60c41e1a7195d156c97218f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.824740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24f304fa60c41e1a7195d156c97218f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.826829 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.873051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af3818e84e044d882d7bab32592f086'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.888890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af3818e84e044d882d7bab32592f086'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.889629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af3818e84e044d882d7bab32592f086'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.896671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1104/2244] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:21 2022] DELETE /identity/v3/users/0af3818e84e044d882d7bab32592f086 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:21.897526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.898855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.945364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24f304fa60c41e1a7195d156c97218f', 'request_id': 'req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.954728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24f304fa60c41e1a7195d156c97218f', 'request_id': 'req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:21.977968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21a4d-5f6f-4b2e-8330-e7ec7564d2ed admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.036922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24f304fa60c41e1a7195d156c97218f', 'request_id': 'req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.037397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3ea3-2758-4e88-922f-242718589b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.041207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3ea3-2758-4e88-922f-242718589b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.041207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3ea3-2758-4e88-922f-242718589b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.041207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3ea3-2758-4e88-922f-242718589b2b admin admin] PATH_INFO: `/v3/projects/4461946d44b54645a1abf69541618996/users/d4b6c6275d6d4329b4b73faddaa85483/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.049568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] The token cache is being invalidate because project b24f304fa60c41e1a7195d156c97218f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:22.049876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.050551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.052506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1141/2245] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:21 2022] DELETE /identity/v3/projects/b24f304fa60c41e1a7195d156c97218f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:22.060033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3ea3-2758-4e88-922f-242718589b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4461946d44b54645a1abf69541618996, user_id=d4b6c6275d6d4329b4b73faddaa85483, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.063061 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3ea3-2758-4e88-922f-242718589b2b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.066246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.067853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.081701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9c5d-4115-4c6b-ade5-fb31e3a1623b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.086616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.087522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.087828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.088656 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] PATH_INFO: `/v3/users/68c5f5c018394995a6a7c44e8005754f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.089899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c5f5c018394995a6a7c44e8005754f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.091822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.154175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1105/2246] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:21 2022] PUT /identity/v3/projects/4461946d44b54645a1abf69541618996/users/d4b6c6275d6d4329b4b73faddaa85483/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:22.168070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.168359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.170178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.212052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] MFA Rules not processed for user `d4b6c6275d6d4329b4b73faddaa85483`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:22.212711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.290299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c5f5c018394995a6a7c44e8005754f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.291520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c5f5c018394995a6a7c44e8005754f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.292723 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1106/2247] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:22.293633 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.295222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.363757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38816c-1dab-4079-8080-edc5d90f9b09 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.368471 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.376949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.376949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.376949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] PATH_INFO: `/v3/projects/4bcff1a488e2489b86e052406f711635` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.376949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcff1a488e2489b86e052406f711635)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.376949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.407954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c5f5c018394995a6a7c44e8005754f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.415735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c5f5c018394995a6a7c44e8005754f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.417125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c5f5c018394995a6a7c44e8005754f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.439402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1142/2248] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:22 2022] DELETE /identity/v3/users/68c5f5c018394995a6a7c44e8005754f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:22.440434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.442001 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.514438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cad3c2-5093-4b85-9080-372428e1daf7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.525204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcff1a488e2489b86e052406f711635', 'request_id': 'req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.532329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcff1a488e2489b86e052406f711635', 'request_id': 'req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.565601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cfa0d-5ad6-405d-aebd-5bde4d6f69f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.566340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfa0d-5ad6-405d-aebd-5bde4d6f69f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.566691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfa0d-5ad6-405d-aebd-5bde4d6f69f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.567056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfa0d-5ad6-405d-aebd-5bde4d6f69f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.568949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cd1cfa0d-5ad6-405d-aebd-5bde4d6f69f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.629847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cfa0d-5ad6-405d-aebd-5bde4d6f69f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.631277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cfa0d-5ad6-405d-aebd-5bde4d6f69f6 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.640179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1143/2249] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:22.656748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcff1a488e2489b86e052406f711635', 'request_id': 'req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.672221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] The token cache is being invalidate because project 4bcff1a488e2489b86e052406f711635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:22.672514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.673192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4784bd96-9ef9-4f81-b170-0c1caeb7f79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:22.675920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1107/2250] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:22 2022] DELETE /identity/v3/projects/4bcff1a488e2489b86e052406f711635 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:22.680849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1a23e-a10f-410f-872c-3869d1ee2609 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.681138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1a23e-a10f-410f-872c-3869d1ee2609 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.681909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1a23e-a10f-410f-872c-3869d1ee2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.700672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-91f1a23e-a10f-410f-872c-3869d1ee2609 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:22.701953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-91f1a23e-a10f-410f-872c-3869d1ee2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.785208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1144/2251] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:22.794679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ec56-d6ca-4c7c-a44e-443ef91fad08 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.794983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ec56-d6ca-4c7c-a44e-443ef91fad08 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.795253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ec56-d6ca-4c7c-a44e-443ef91fad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.818702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a6f4ec56-d6ca-4c7c-a44e-443ef91fad08 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:22.820036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a6f4ec56-d6ca-4c7c-a44e-443ef91fad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.829048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1108/2252] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:22.833089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1a23e-a10f-410f-872c-3869d1ee2609 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.843494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1a23e-a10f-410f-872c-3869d1ee2609 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.848602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.849609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.849609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.849875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.850592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:22.850902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.852549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.864438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1145/2253] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:22.868925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4ec56-d6ca-4c7c-a44e-443ef91fad08 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.878333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4ec56-d6ca-4c7c-a44e-443ef91fad08 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.883037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.883831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.884116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.884390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.885622 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.887511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.967168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.969711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:22.990320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313ec80-9e71-4c3d-9e53-b857d340bae7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.998350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.999961 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.000474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.002085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] PATH_INFO: `/v3/projects/bbda173d204a4d78997e4f236a4c0990` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.003958 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbda173d204a4d78997e4f236a4c0990)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.006347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.026797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1109/2254] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:22 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:23.028572 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.088683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413049a1-7cb9-4423-97d4-967ce8b13ed2 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.093401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.097311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.097311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.097311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.097311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.097755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.174316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbda173d204a4d78997e4f236a4c0990', 'request_id': 'req-97efde29-0c4b-4462-9a9f-4430054041fc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:23.182138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbda173d204a4d78997e4f236a4c0990', 'request_id': 'req-97efde29-0c4b-4462-9a9f-4430054041fc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:23.228135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1110/2255] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:23 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:23.231798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.241193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40887-deda-44da-a25b-85c087bb92f0 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.297058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.297733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.298009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.298287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.299011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.300672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.312707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1111/2256] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:32:23.317265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.327641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4514-6111-4f5d-a9dc-efcbaf2d20ec admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.332469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.333133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.333418 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.333693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.334448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.336090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.339582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbda173d204a4d78997e4f236a4c0990', 'request_id': 'req-97efde29-0c4b-4462-9a9f-4430054041fc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:23.353015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] The token cache is being invalidate because project bbda173d204a4d78997e4f236a4c0990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:23.356416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:23.356521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1112/2257] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:32:23.357066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97efde29-0c4b-4462-9a9f-4430054041fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:23.357343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.359213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:23.362382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1146/2258] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:22 2022] DELETE /identity/v3/projects/bbda173d204a4d78997e4f236a4c0990 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:23.363862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062dee0-b876-43a5-880e-c2d527fb95d8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.364252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062dee0-b876-43a5-880e-c2d527fb95d8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.364658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062dee0-b876-43a5-880e-c2d527fb95d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.375677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba5e5b-04e7-4707-a672-182b64dbf38f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.381367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9ec2-a715-4f45-bf5d-bd02f395f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.383528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9ec2-a715-4f45-bf5d-bd02f395f4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.383528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9ec2-a715-4f45-bf5d-bd02f395f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.383528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9ec2-a715-4f45-bf5d-bd02f395f4a7 admin admin] PATH_INFO: `/v3/projects/fb8f41c28446447cb3a417f239770722/users/55e86a79995740c0a8f4e4a10954684f/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.391353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c062dee0-b876-43a5-880e-c2d527fb95d8 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:23.393000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c062dee0-b876-43a5-880e-c2d527fb95d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:23.403902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1147/2259] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:23.405476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9ec2-a715-4f45-bf5d-bd02f395f4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8f41c28446447cb3a417f239770722, user_id=55e86a79995740c0a8f4e4a10954684f, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.409226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9ec2-a715-4f45-bf5d-bd02f395f4a7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.421668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fcc1-ebf9-4557-b55a-0ce6b4960d60 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.421668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fcc1-ebf9-4557-b55a-0ce6b4960d60 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.421668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fcc1-ebf9-4557-b55a-0ce6b4960d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.434598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-92b6fcc1-ebf9-4557-b55a-0ce6b4960d60 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:23.435901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-92b6fcc1-ebf9-4557-b55a-0ce6b4960d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:23.448149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1148/2260] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:23.449230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6fcc1-ebf9-4557-b55a-0ce6b4960d60 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.463605 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6fcc1-ebf9-4557-b55a-0ce6b4960d60 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.469850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.470546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.470834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.471234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.472392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:23.472772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.474551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.492810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1149/2261] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:23.493468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.504846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d541dc1-8d1d-4e8b-adbe-f99890f1b23a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.513687 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.514319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.514598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.514881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.515628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.530808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.531350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1113/2262] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:23 2022] PUT /identity/v3/projects/fb8f41c28446447cb3a417f239770722/users/55e86a79995740c0a8f4e4a10954684f/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:23.539924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.540240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.540518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.569006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] MFA Rules not processed for user `55e86a79995740c0a8f4e4a10954684f`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:23.570227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:23.638598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1114/2263] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:23.650927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.652607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:23.661697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1150/2264] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:23 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:23.666861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.723755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f6fa3-5eb1-40aa-a163-0bb02f0a156f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.734376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9387c-2630-4395-b75a-a19255ddaf19 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.739308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.740014 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.740319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.740568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.741251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.743233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.785604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc69b41ea4d6456f9532cee386265e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.786267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.786555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.786838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.847316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.848835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.852206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1151/2265] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:23 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:23.858862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.859693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1115/2266] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:23.865183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2768a-854b-4eec-ae1d-2e44cc740244 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.870366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.871049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.871335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.871665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.872382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.874075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.884895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1152/2267] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:23.890014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.901754 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e51ee2-e324-4b86-94c2-d31eaaf21d17 service glance] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.909579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9814a5-7f5c-48b4-bcaa-096ce1be9eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.910257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9814a5-7f5c-48b4-bcaa-096ce1be9eba admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.910547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9814a5-7f5c-48b4-bcaa-096ce1be9eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.910830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9814a5-7f5c-48b4-bcaa-096ce1be9eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.911599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9814a5-7f5c-48b4-bcaa-096ce1be9eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.913239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9814a5-7f5c-48b4-bcaa-096ce1be9eba admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.924316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1116/2268] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:23.928655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.939455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436497d0-bd64-4f34-acea-3fce481a93be admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.944325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.945215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.945501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.945784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] PATH_INFO: `/v3/projects/9163f7a2ccc347a391a3541778b4bdca/users/c552caed303e4f72b7121fc979cc302d/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.963317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9163f7a2ccc347a391a3541778b4bdca, user_id=c552caed303e4f72b7121fc979cc302d, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.966056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:24.071057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1153/2269] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:23 2022] PUT /identity/v3/projects/9163f7a2ccc347a391a3541778b4bdca/users/c552caed303e4f72b7121fc979cc302d/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:24.076661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d43a-c3b5-4429-9702-65aa9eeeebaf None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:24.076955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d43a-c3b5-4429-9702-65aa9eeeebaf None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:24.077275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d43a-c3b5-4429-9702-65aa9eeeebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:24.095946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0f75d43a-c3b5-4429-9702-65aa9eeeebaf None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:24.097165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0f75d43a-c3b5-4429-9702-65aa9eeeebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:24.162644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1117/2270] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:24.170856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:24.175931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:24.258745 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccc73b-aa0b-4320-aa75-c0dad54fcf71 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:24.263007 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:24.263709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:24.264008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:24.264269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:24.274531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:24.276402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:24.288056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1154/2271] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:25.760473 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b1711-d047-4725-99ac-c21ee1187962 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:25.761405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b1711-d047-4725-99ac-c21ee1187962 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:25.761932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b1711-d047-4725-99ac-c21ee1187962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:25.795360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-2a2b1711-d047-4725-99ac-c21ee1187962 None None] MFA Rules not processed for user `c552caed303e4f72b7121fc979cc302d`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:25.797066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2a2b1711-d047-4725-99ac-c21ee1187962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:25.888725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1118/2272] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:25.900836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:25.902386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:25.996778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfc006-0959-4575-9ddd-33a915429e0d service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:26.000598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:26.001255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:26.001533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:26.001815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:26.013602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:26.015015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:26.027352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1155/2273] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:27.938807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc92e5a-987c-4433-89ee-ea4223a4f2b0 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:27.939900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc92e5a-987c-4433-89ee-ea4223a4f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:27.939900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc92e5a-987c-4433-89ee-ea4223a4f2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:27.961017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0dc92e5a-987c-4433-89ee-ea4223a4f2b0 None None] MFA Rules not processed for user `c552caed303e4f72b7121fc979cc302d`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:27.962352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0dc92e5a-987c-4433-89ee-ea4223a4f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:27.970487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1119/2274] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:38.546828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:38.551015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:38.578750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd913b-9ebd-4864-b3c7-c983695ecb64 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:38.585281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:38.586573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:38.587230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:38.588472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] PATH_INFO: `/v3/users/d4b6c6275d6d4329b4b73faddaa85483` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:38.590509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b6c6275d6d4329b4b73faddaa85483)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:38.594635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:38.910403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b6c6275d6d4329b4b73faddaa85483'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:38.911069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b6c6275d6d4329b4b73faddaa85483'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.048243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b6c6275d6d4329b4b73faddaa85483'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.060812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b6c6275d6d4329b4b73faddaa85483'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.061790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b6c6275d6d4329b4b73faddaa85483'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.082694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1156/2275] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:38 2022] DELETE /identity/v3/users/d4b6c6275d6d4329b4b73faddaa85483 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:39.088010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.088907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.089189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.108708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:39.109926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:39.180759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1120/2276] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:39.191346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:39.192981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:39.257855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831969be-939f-4f64-8313-d536156fc92c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:39.262598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:39.263248 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.263571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.263840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.273220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:39.274576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:39.285782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1157/2277] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:39.719361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:39.720907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:39.733483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610c1af-7d21-4cd4-a355-cde62efb583f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:39.744428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:39.745312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.745805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.746037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] PATH_INFO: `/v3/projects/4461946d44b54645a1abf69541618996` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.747275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4461946d44b54645a1abf69541618996)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:39.749315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:39.852251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4461946d44b54645a1abf69541618996', 'request_id': 'req-61950da4-89ca-423a-8227-4179662b50f2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.861587 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4461946d44b54645a1abf69541618996', 'request_id': 'req-61950da4-89ca-423a-8227-4179662b50f2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.930762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4461946d44b54645a1abf69541618996', 'request_id': 'req-61950da4-89ca-423a-8227-4179662b50f2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.942447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] The token cache is being invalidate because project 4461946d44b54645a1abf69541618996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:39.942976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.943851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-61950da4-89ca-423a-8227-4179662b50f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:39.960300 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1121/2278] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:39 2022] DELETE /identity/v3/projects/4461946d44b54645a1abf69541618996 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:46.791310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.793739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:46.806747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b09c1b-bf2e-49cf-bffe-1fb58422dd39 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.870236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.871138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.871421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.871729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] PATH_INFO: `/v3/users/55e86a79995740c0a8f4e4a10954684f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.873560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e86a79995740c0a8f4e4a10954684f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.875896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.076739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e86a79995740c0a8f4e4a10954684f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.077567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e86a79995740c0a8f4e4a10954684f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.165969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e86a79995740c0a8f4e4a10954684f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.180387 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e86a79995740c0a8f4e4a10954684f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.181595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e86a79995740c0a8f4e4a10954684f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.205560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1158/2279] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:32:46 2022] DELETE /identity/v3/users/55e86a79995740c0a8f4e4a10954684f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:47.210116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.210602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.210695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.229301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:47.230546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.322345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1122/2280] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:47.334227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.337095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.404330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f8871-6a93-4401-bb8b-1472c68b61a3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.408032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9e566-5001-406b-ae08-cd6969712db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.408681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e566-5001-406b-ae08-cd6969712db6 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.408959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e566-5001-406b-ae08-cd6969712db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.409234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e566-5001-406b-ae08-cd6969712db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.422360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9e566-5001-406b-ae08-cd6969712db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.424572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9e566-5001-406b-ae08-cd6969712db6 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.437878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1159/2281] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:48.147851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.150430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.186720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05dbe3-592e-4c1d-8661-072248111791 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.191903 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.192805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.193058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.193784 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] PATH_INFO: `/v3/projects/fb8f41c28446447cb3a417f239770722` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.195049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8f41c28446447cb3a417f239770722)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.197860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.357834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8f41c28446447cb3a417f239770722', 'request_id': 'req-f1df55ff-16a0-4193-9243-b661718dc546'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:48.367287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8f41c28446447cb3a417f239770722', 'request_id': 'req-f1df55ff-16a0-4193-9243-b661718dc546'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:48.451068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8f41c28446447cb3a417f239770722', 'request_id': 'req-f1df55ff-16a0-4193-9243-b661718dc546'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:48.477738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] The token cache is being invalidate because project fb8f41c28446447cb3a417f239770722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:48.478121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:48.478928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f1df55ff-16a0-4193-9243-b661718dc546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:48.480663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1123/2282] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:32:48 2022] DELETE /identity/v3/projects/fb8f41c28446447cb3a417f239770722 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:48.485988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01afdc-135b-4dec-960e-fde0b0bad52e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.487532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01afdc-135b-4dec-960e-fde0b0bad52e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.488396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01afdc-135b-4dec-960e-fde0b0bad52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.519003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7f01afdc-135b-4dec-960e-fde0b0bad52e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:48.520633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7f01afdc-135b-4dec-960e-fde0b0bad52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.632561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1160/2283] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:48.642488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5c64e-0437-4187-878c-b87ecd356a19 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.643102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5c64e-0437-4187-878c-b87ecd356a19 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.643966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5c64e-0437-4187-878c-b87ecd356a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.679781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c9c5c64e-0437-4187-878c-b87ecd356a19 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:48.681097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c9c5c64e-0437-4187-878c-b87ecd356a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.702762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1124/2284] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:48.703462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01afdc-135b-4dec-960e-fde0b0bad52e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.732853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01afdc-135b-4dec-960e-fde0b0bad52e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.749676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fc9cd-69e9-4ec0-b993-c6316f1901ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.750313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc9cd-69e9-4ec0-b993-c6316f1901ec admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.750604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc9cd-69e9-4ec0-b993-c6316f1901ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.750887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc9cd-69e9-4ec0-b993-c6316f1901ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.751975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fc9cd-69e9-4ec0-b993-c6316f1901ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:48.752299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fc9cd-69e9-4ec0-b993-c6316f1901ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.765270 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fc9cd-69e9-4ec0-b993-c6316f1901ec admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.784616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5c64e-0437-4187-878c-b87ecd356a19 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.798028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1161/2285] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:48.798669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5c64e-0437-4187-878c-b87ecd356a19 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.804221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.805048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.805391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.805729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.807192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.809546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.844477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf3bb-e045-425f-beae-5767f70c38ca None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.844852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf3bb-e045-425f-beae-5767f70c38ca None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.845226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf3bb-e045-425f-beae-5767f70c38ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.865578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d9ecf3bb-e045-425f-beae-5767f70c38ca None None] MFA Rules not processed for user `68239e70245a4922b8c7961dd8962baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:48.871744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d9ecf3bb-e045-425f-beae-5767f70c38ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.935777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1125/2286] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:48.937171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:49.023116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1162/2287] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:49.111116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86919bef-51bf-4abc-a78a-38e437d37313 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:49.187020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:49.187020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:49.187020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:49.187020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:49.187753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:49.187753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:49.479639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1126/2288] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/users => generated 289 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:49.484977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf3bb-e045-425f-beae-5767f70c38ca None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:49.504392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf3bb-e045-425f-beae-5767f70c38ca None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:49.509629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:49.510319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:49.510606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:49.510884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:49.511881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:49.513508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:49.525351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1163/2289] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:32:49.530827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:49.547688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682dda-36b9-4aac-8ad4-2e7b6e0c5c7e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:49.554348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e97b3-c2db-41c5-8291-394de8004a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:49.555060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e97b3-c2db-41c5-8291-394de8004a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:49.555340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e97b3-c2db-41c5-8291-394de8004a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:49.555661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e97b3-c2db-41c5-8291-394de8004a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:49.556412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e97b3-c2db-41c5-8291-394de8004a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:49.557999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e97b3-c2db-41c5-8291-394de8004a33 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:49.575830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1127/2290] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:49.576072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:49.583923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4539-1f62-4986-9783-255ee6f5a09f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:49.589290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:49.590191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:49.590503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:49.590783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] PATH_INFO: `/v3/projects/d986365ac2604f49b6801b560f730385/users/9def3b0e9a3148c08a662944b39a72e7/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:49.608670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d986365ac2604f49b6801b560f730385, user_id=9def3b0e9a3148c08a662944b39a72e7, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:49.611815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:49.744078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1164/2291] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:32:49 2022] PUT /identity/v3/projects/d986365ac2604f49b6801b560f730385/users/9def3b0e9a3148c08a662944b39a72e7/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:49.756270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5306-6c14-464a-a77c-854f0e7b70e5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:49.756738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5306-6c14-464a-a77c-854f0e7b70e5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:49.757071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5306-6c14-464a-a77c-854f0e7b70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:49.789610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-cbec5306-6c14-464a-a77c-854f0e7b70e5 None None] MFA Rules not processed for user `9def3b0e9a3148c08a662944b39a72e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:49.791695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cbec5306-6c14-464a-a77c-854f0e7b70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:49.897561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1128/2292] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:49.912142 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:49.914441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:50.033600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f5df-5e41-45fb-b268-1a0d520f34e4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:50.039557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a069db-9590-4325-b77c-2807d32666b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:50.043371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a069db-9590-4325-b77c-2807d32666b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.043371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a069db-9590-4325-b77c-2807d32666b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.043371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a069db-9590-4325-b77c-2807d32666b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.052207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a069db-9590-4325-b77c-2807d32666b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:50.053714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a069db-9590-4325-b77c-2807d32666b6 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:50.065367 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1165/2293] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:32:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:50.772729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713d91a-dcc8-407b-9c34-c93cabaed7a7 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.773326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713d91a-dcc8-407b-9c34-c93cabaed7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.773326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713d91a-dcc8-407b-9c34-c93cabaed7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.793054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-4713d91a-dcc8-407b-9c34-c93cabaed7a7 None None] MFA Rules not processed for user `2ca44c6702304a53a176bebdb6ccbe3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:50.794270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4713d91a-dcc8-407b-9c34-c93cabaed7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:50.854412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1129/2294] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:51.404015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.404530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.404631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.430907 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] MFA Rules not processed for user `c552caed303e4f72b7121fc979cc302d`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:51.436189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:51.504838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1166/2295] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:56.705150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:56.706049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:56.706495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:56.823874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:56.826080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:56.951926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1130/2296] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:57.014875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:57.016382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:57.135104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f23fdb-0819-4b29-81f3-fd82d02e61b5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:57.140937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ab348-566c-4178-9ee5-70a5f04dcd2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:57.141595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ab348-566c-4178-9ee5-70a5f04dcd2c service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:57.142018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ab348-566c-4178-9ee5-70a5f04dcd2c service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:57.142304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ab348-566c-4178-9ee5-70a5f04dcd2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:57.153979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ab348-566c-4178-9ee5-70a5f04dcd2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:57.153979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ab348-566c-4178-9ee5-70a5f04dcd2c service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:57.162810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1167/2297] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:33:12.131266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.132739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.195960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8c947-5c94-4af0-9ca6-11edd38df965 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.200920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.201783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.202086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.202361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] PATH_INFO: `/v3/users/51d90075e9d546d98ea11e2f1dd7002c` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.203578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d90075e9d546d98ea11e2f1dd7002c)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.205502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.411248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d90075e9d546d98ea11e2f1dd7002c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.418717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d90075e9d546d98ea11e2f1dd7002c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.500925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d90075e9d546d98ea11e2f1dd7002c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.513009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d90075e9d546d98ea11e2f1dd7002c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.513680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d90075e9d546d98ea11e2f1dd7002c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.519762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1131/2298] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:33:12 2022] DELETE /identity/v3/users/51d90075e9d546d98ea11e2f1dd7002c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:12.524344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.524903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.524903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.547417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:12.548904 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.615663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1168/2299] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:12.625417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.626929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.690989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7be22-c604-414c-a7e2-59d004b5fd1c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.694977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.695933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.696423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.696880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.714225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.715741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.730103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1132/2300] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:13.781253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:13.783593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:13.804602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c3c27-7893-4587-a426-9421171ede2e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:13.819706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:13.820821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:13.821898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:13.822279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] PATH_INFO: `/v3/projects/4eb5683e461644a9965b517b46804c63` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:13.823764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb5683e461644a9965b517b46804c63)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:13.826078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:13.945614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb5683e461644a9965b517b46804c63', 'request_id': 'req-1d293e08-a273-4806-a89d-9846254fa687'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:13.952883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb5683e461644a9965b517b46804c63', 'request_id': 'req-1d293e08-a273-4806-a89d-9846254fa687'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:14.049356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb5683e461644a9965b517b46804c63', 'request_id': 'req-1d293e08-a273-4806-a89d-9846254fa687'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:14.074187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] The token cache is being invalidate because project 4eb5683e461644a9965b517b46804c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:14.074718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:14.075726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1d293e08-a273-4806-a89d-9846254fa687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:14.078468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1169/2301] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:33:13 2022] DELETE /identity/v3/projects/4eb5683e461644a9965b517b46804c63 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:16.903156 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.904696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:16.918330 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cac4f8-711d-422b-a409-90c390d7ff07 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.979536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.980427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.980704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.980978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] PATH_INFO: `/v3/users/9def3b0e9a3148c08a662944b39a72e7` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.982186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9def3b0e9a3148c08a662944b39a72e7)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.984161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.223757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9def3b0e9a3148c08a662944b39a72e7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.231857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9def3b0e9a3148c08a662944b39a72e7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.351933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9def3b0e9a3148c08a662944b39a72e7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.368302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9def3b0e9a3148c08a662944b39a72e7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.369060 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9def3b0e9a3148c08a662944b39a72e7'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.375200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1133/2302] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:33:16 2022] DELETE /identity/v3/users/9def3b0e9a3148c08a662944b39a72e7 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:17.382386 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.382880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.382966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.401978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:17.403170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:17.468540 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1170/2303] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:17.478795 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.480397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:17.543680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61d2e-8885-476a-b7c6-338edc102579 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.547932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e22df-48a2-4a1e-9c0d-d70b0f0c0f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.548617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e22df-48a2-4a1e-9c0d-d70b0f0c0f85 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.548904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e22df-48a2-4a1e-9c0d-d70b0f0c0f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.549182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e22df-48a2-4a1e-9c0d-d70b0f0c0f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.559899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e22df-48a2-4a1e-9c0d-d70b0f0c0f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:17.561397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e22df-48a2-4a1e-9c0d-d70b0f0c0f85 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.572570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1134/2304] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:18.239850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.241286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.262526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce44bf-c44b-4195-a061-1c77aedb2f66 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:18.271396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:18.273897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.275916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.276337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] PATH_INFO: `/v3/projects/d986365ac2604f49b6801b560f730385` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.279156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d986365ac2604f49b6801b560f730385)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.283042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:18.412573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd986365ac2604f49b6801b560f730385', 'request_id': 'req-60781ede-45c8-4480-a70f-9b3e58eb1ac9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.420608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd986365ac2604f49b6801b560f730385', 'request_id': 'req-60781ede-45c8-4480-a70f-9b3e58eb1ac9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.567848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd986365ac2604f49b6801b560f730385', 'request_id': 'req-60781ede-45c8-4480-a70f-9b3e58eb1ac9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.579779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] The token cache is being invalidate because project d986365ac2604f49b6801b560f730385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:18.580156 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.580877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-60781ede-45c8-4480-a70f-9b3e58eb1ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.582602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1171/2305] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:33:18 2022] DELETE /identity/v3/projects/d986365ac2604f49b6801b560f730385 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:18.588354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e2fb-efc3-49a6-99ea-603122facc17 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.588871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e2fb-efc3-49a6-99ea-603122facc17 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.588968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e2fb-efc3-49a6-99ea-603122facc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.609725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3561e2fb-efc3-49a6-99ea-603122facc17 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:18.610937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3561e2fb-efc3-49a6-99ea-603122facc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.677428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202136a0-369e-4a23-8ee1-31b3cf24878e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.677428 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202136a0-369e-4a23-8ee1-31b3cf24878e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.677878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202136a0-369e-4a23-8ee1-31b3cf24878e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.679412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1172/2306] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:18.693762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.694063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.694348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.714534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1135/2307] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:18.720073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c38e60-59f6-4dd4-854c-1d21c2e08310 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.720456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c38e60-59f6-4dd4-854c-1d21c2e08310 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.720749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c38e60-59f6-4dd4-854c-1d21c2e08310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.757038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-39c38e60-59f6-4dd4-854c-1d21c2e08310 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:18.758341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-39c38e60-59f6-4dd4-854c-1d21c2e08310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.767535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1136/2308] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:18.772335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:18.772552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c38e60-59f6-4dd4-854c-1d21c2e08310 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.774438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.784195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c38e60-59f6-4dd4-854c-1d21c2e08310 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:18.789051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:18.790570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.790926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.791275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.792277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:18.792660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.794355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:18.818026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1137/2309] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:18.822762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.835253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1290b-d917-4aa6-afde-1022aa6d456e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:18.841718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:18.842512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.842870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.843507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.844259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.846416 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:18.871695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1173/2310] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:18.888199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.889621 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.976354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d76fb8-52e7-4550-8fd9-3d3608f10c51 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:18.981599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc69b41ea4d6456f9532cee386265e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:18.982363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.982654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.982935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.991080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1138/2311] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:18.995628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.995778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.995778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.007353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1174/2312] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:19.061713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563b27-6f5b-478a-b53c-f75a239f2fe9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.066503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.067305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.067641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.067915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.068608 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.070535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.165629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1139/2313] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:19.169880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.181827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f000f-9446-4caa-8b06-c38ffe9e7981 service glance] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.187310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0d345-1255-455e-b6d4-89d3012ae5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.188198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d345-1255-455e-b6d4-89d3012ae5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.188549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d345-1255-455e-b6d4-89d3012ae5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.188893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d345-1255-455e-b6d4-89d3012ae5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.189708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0d345-1255-455e-b6d4-89d3012ae5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.191605 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0d345-1255-455e-b6d4-89d3012ae5fb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.203358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1175/2314] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:19.207577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.218891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a61e6-d7d9-4d25-bf54-2473e3544950 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.224058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.229903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a5e9-2edc-4a2e-8b74-c01da77b1360 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.229903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a5e9-2edc-4a2e-8b74-c01da77b1360 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.230143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.230238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a5e9-2edc-4a2e-8b74-c01da77b1360 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.230343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.230343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.230343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.230558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1176/2315] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:33:19.230641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.232099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.232390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.232670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.243451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1140/2316] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:19.244687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.252553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] MFA Rules not processed for user `9c25e83af7604455bad1d7c0ee1c0122`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:19.253885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.255594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cec66-c63b-4fa3-9dc3-01bce68c6f95 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.265513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c680b-1817-418a-8cda-01664b772fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.265513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c680b-1817-418a-8cda-01664b772fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.265513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c680b-1817-418a-8cda-01664b772fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.265513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c680b-1817-418a-8cda-01664b772fc2 admin admin] PATH_INFO: `/v3/projects/acf57b560d954a068825eb46975a6c1b/users/a7fc6e047d364346a0b6c15edab62b5e/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.281791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c680b-1817-418a-8cda-01664b772fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf57b560d954a068825eb46975a6c1b, user_id=a7fc6e047d364346a0b6c15edab62b5e, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.284730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c680b-1817-418a-8cda-01664b772fc2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.311981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1177/2317] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:19.324929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.326369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.337439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af284151-caa1-4f37-9b3d-ec7d5831dc86 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.341325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78122a40-f5c4-4dbd-82b0-3466873d448c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.341982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78122a40-f5c4-4dbd-82b0-3466873d448c service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.342259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78122a40-f5c4-4dbd-82b0-3466873d448c service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.342533 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78122a40-f5c4-4dbd-82b0-3466873d448c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.351379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78122a40-f5c4-4dbd-82b0-3466873d448c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.352885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78122a40-f5c4-4dbd-82b0-3466873d448c service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.364151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1178/2318] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:19.383022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1141/2319] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:33:19 2022] PUT /identity/v3/projects/acf57b560d954a068825eb46975a6c1b/users/a7fc6e047d364346a0b6c15edab62b5e/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:19.402170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.407403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.407403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.471679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] MFA Rules not processed for user `a7fc6e047d364346a0b6c15edab62b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:19.473684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.479996 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d84bf-8dcf-4038-a317-95bed270a462 None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.480465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d84bf-8dcf-4038-a317-95bed270a462 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.480841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d84bf-8dcf-4038-a317-95bed270a462 None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.482657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1142/2320] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:33:19.494298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.494962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.495341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.532586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:19.534758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.575368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1179/2321] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:19.597080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.599006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.636442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1143/2322] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:19.653489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.655863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.689649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d519-53fc-46f4-b6d7-75433bf370fd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.702337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.703218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.703640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.704012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.723035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.728187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.734570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d195e-d097-464c-abd6-02f47038a072 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.738955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d507b4-d7d1-4c11-aaa4-36bf16283da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.740069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d507b4-d7d1-4c11-aaa4-36bf16283da7 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.740422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d507b4-d7d1-4c11-aaa4-36bf16283da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.740767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d507b4-d7d1-4c11-aaa4-36bf16283da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.758940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1180/2323] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:19.766774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d507b4-d7d1-4c11-aaa4-36bf16283da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.772217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d507b4-d7d1-4c11-aaa4-36bf16283da7 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.800126 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1144/2324] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:24.028727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.098777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc824ff-ea66-41cd-9ae5-e3312f84c6f6 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.104111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.104995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.105274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.105553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] PATH_INFO: `/v3/users/a7fc6e047d364346a0b6c15edab62b5e` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.106767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fc6e047d364346a0b6c15edab62b5e)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.108786 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.397765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fc6e047d364346a0b6c15edab62b5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.398419 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fc6e047d364346a0b6c15edab62b5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.493139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.493139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.493830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.511801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.513029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.535237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fc6e047d364346a0b6c15edab62b5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.544695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fc6e047d364346a0b6c15edab62b5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.564489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b09e9bcd-3dd6-46ed-9b4b-40082e7a2b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fc6e047d364346a0b6c15edab62b5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.572321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1145/2325] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:24.586706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.590691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.591141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1181/2326] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:33:24 2022] DELETE /identity/v3/users/a7fc6e047d364346a0b6c15edab62b5e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:24.593290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.593739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.594163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.614054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.615260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.685327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d2805-5986-4ac0-a028-f715c739ec79 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.713288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1182/2327] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:24.723197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.724686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.755402 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107f86-daa0-4665-9f0c-534459bb311e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.756147 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107f86-daa0-4665-9f0c-534459bb311e service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.756446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107f86-daa0-4665-9f0c-534459bb311e service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.756732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107f86-daa0-4665-9f0c-534459bb311e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.792737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e6762-a678-4856-8457-888b55bfde81 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.796599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.797249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.797529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.797802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.809952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.811542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.822781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107f86-daa0-4665-9f0c-534459bb311e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.824287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1183/2328] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:24.824748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107f86-daa0-4665-9f0c-534459bb311e service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.840838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1146/2329] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:33:25.390568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.392097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:25.411406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f97b-ede5-427e-899a-f377bcb09603 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.433296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.434238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.434508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.434785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] PATH_INFO: `/v3/projects/acf57b560d954a068825eb46975a6c1b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.438818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf57b560d954a068825eb46975a6c1b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.440822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.587162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf57b560d954a068825eb46975a6c1b', 'request_id': 'req-d6cd95c6-3162-4f10-9682-681e9d48ec24'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:25.597689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf57b560d954a068825eb46975a6c1b', 'request_id': 'req-d6cd95c6-3162-4f10-9682-681e9d48ec24'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:25.671750 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf57b560d954a068825eb46975a6c1b', 'request_id': 'req-d6cd95c6-3162-4f10-9682-681e9d48ec24'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:25.685518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] The token cache is being invalidate because project acf57b560d954a068825eb46975a6c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:25.685910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:25.686635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d6cd95c6-3162-4f10-9682-681e9d48ec24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:25.688689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1184/2330] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:33:25 2022] DELETE /identity/v3/projects/acf57b560d954a068825eb46975a6c1b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:25.695039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972dbd5-b1ee-42d9-ae94-9bb9b5f736c2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.695629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972dbd5-b1ee-42d9-ae94-9bb9b5f736c2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.696264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972dbd5-b1ee-42d9-ae94-9bb9b5f736c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.729506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6972dbd5-b1ee-42d9-ae94-9bb9b5f736c2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:25.730774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6972dbd5-b1ee-42d9-ae94-9bb9b5f736c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:25.804108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1147/2331] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:25.812500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44dc26-2819-4269-9712-4eb2ceabba38 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.812891 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44dc26-2819-4269-9712-4eb2ceabba38 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.813247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44dc26-2819-4269-9712-4eb2ceabba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.850256 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2e44dc26-2819-4269-9712-4eb2ceabba38 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:25.851611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2e44dc26-2819-4269-9712-4eb2ceabba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:25.871798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972dbd5-b1ee-42d9-ae94-9bb9b5f736c2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.880945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972dbd5-b1ee-42d9-ae94-9bb9b5f736c2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.881152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1185/2332] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:25.887260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.888372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.888954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.889565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.890514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:25.891069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.893054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.911325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44dc26-2819-4269-9712-4eb2ceabba38 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.918781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1148/2333] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:25.928626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44dc26-2819-4269-9712-4eb2ceabba38 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.934781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.935662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.936082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.936489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.937391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.940210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.057806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1186/2334] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:26.061971 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.076773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210192cc-fcb4-48fa-807f-d6f743e2adb9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.165100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.165821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.166214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.166511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.167356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.171562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.318508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1149/2335] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:26.323325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.333785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d798-0c2b-4f25-aaa6-95c7e749b6f6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.338885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.339573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.339860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.340135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.340854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.342549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.358416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1187/2336] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:26.359514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.369811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32bde-dac6-4073-81f4-c7e7cbb8d5a6 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.374583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d441d-e307-42cd-81a8-0b2875cded52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.375934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d441d-e307-42cd-81a8-0b2875cded52 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.376229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d441d-e307-42cd-81a8-0b2875cded52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.376509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d441d-e307-42cd-81a8-0b2875cded52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.377236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d441d-e307-42cd-81a8-0b2875cded52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.378841 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d441d-e307-42cd-81a8-0b2875cded52 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.394948 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1150/2337] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:26.400208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.410933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ceb55-2790-40e1-9ddb-624ac7d6157d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.420905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.421821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.422180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.422531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] PATH_INFO: `/v3/projects/780d4e20b07c4ee88af51bcfe43d3673/users/764d72a4b47c4796aabdab334fe1b3d4/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.438846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=780d4e20b07c4ee88af51bcfe43d3673, user_id=764d72a4b47c4796aabdab334fe1b3d4, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.441694 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.582165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1188/2338] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:33:26 2022] PUT /identity/v3/projects/780d4e20b07c4ee88af51bcfe43d3673/users/764d72a4b47c4796aabdab334fe1b3d4/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:26.593999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947c5c2-905b-4aa4-91e4-00e014a326b4 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.594337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947c5c2-905b-4aa4-91e4-00e014a326b4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.594627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947c5c2-905b-4aa4-91e4-00e014a326b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.628074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6947c5c2-905b-4aa4-91e4-00e014a326b4 None None] MFA Rules not processed for user `764d72a4b47c4796aabdab334fe1b3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:26.629465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6947c5c2-905b-4aa4-91e4-00e014a326b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.703825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1151/2339] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:26.715393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.717318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.785586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104e75-9239-4228-a23e-766829ce17fe admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.790161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba2e2e-3be8-4445-b423-4bbc33885424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.790824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba2e2e-3be8-4445-b423-4bbc33885424 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.791192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba2e2e-3be8-4445-b423-4bbc33885424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.791487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba2e2e-3be8-4445-b423-4bbc33885424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.802844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba2e2e-3be8-4445-b423-4bbc33885424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.805678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba2e2e-3be8-4445-b423-4bbc33885424 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.817615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1189/2340] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:26.845099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947c5c2-905b-4aa4-91e4-00e014a326b4 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.909303 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947c5c2-905b-4aa4-91e4-00e014a326b4 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.914801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.915710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.915993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.916268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] PATH_INFO: `/v3/users/764d72a4b47c4796aabdab334fe1b3d4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.917482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] RBAC: Authorizing `identity:delete_user(user_id=764d72a4b47c4796aabdab334fe1b3d4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.919407 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.188307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764d72a4b47c4796aabdab334fe1b3d4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.194994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764d72a4b47c4796aabdab334fe1b3d4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.300843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764d72a4b47c4796aabdab334fe1b3d4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.314069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764d72a4b47c4796aabdab334fe1b3d4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.314885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764d72a4b47c4796aabdab334fe1b3d4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.324430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1152/2341] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:33:26 2022] DELETE /identity/v3/users/764d72a4b47c4796aabdab334fe1b3d4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:27.328754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.329040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.329323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.351164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:27.353013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.439401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1190/2342] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:27.451268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.452758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.515864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6f49-0f1f-4458-b562-17ee1119175e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.519574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c4e3c-7e9b-4245-af96-e4036b83223e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.520235 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c4e3c-7e9b-4245-af96-e4036b83223e service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.520582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c4e3c-7e9b-4245-af96-e4036b83223e service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.520865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c4e3c-7e9b-4245-af96-e4036b83223e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.531346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c4e3c-7e9b-4245-af96-e4036b83223e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.532826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c4e3c-7e9b-4245-af96-e4036b83223e service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.551336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1153/2343] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:27.948548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.950009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.965018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0124-038f-4ad2-805c-222bc7fc1d17 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.970984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.972153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.972603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.972883 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] PATH_INFO: `/v3/projects/780d4e20b07c4ee88af51bcfe43d3673` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.974244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=780d4e20b07c4ee88af51bcfe43d3673)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.986128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:28.125259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780d4e20b07c4ee88af51bcfe43d3673', 'request_id': 'req-c23229ec-f73f-44c1-88f4-965cca11b5db'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.131766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780d4e20b07c4ee88af51bcfe43d3673', 'request_id': 'req-c23229ec-f73f-44c1-88f4-965cca11b5db'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.203246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780d4e20b07c4ee88af51bcfe43d3673', 'request_id': 'req-c23229ec-f73f-44c1-88f4-965cca11b5db'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.220051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] The token cache is being invalidate because project 780d4e20b07c4ee88af51bcfe43d3673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:28.220342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.220999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.222605 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1191/2344] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:33:27 2022] DELETE /identity/v3/projects/780d4e20b07c4ee88af51bcfe43d3673 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:31.097856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.098437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.098437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.117265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:31.118347 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:31.177454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1154/2345] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:31.293038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.293038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:31.293038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23229ec-f73f-44c1-88f4-965cca11b5db admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.294065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d16381-9e63-4900-966a-a00c23b81bf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.294065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16381-9e63-4900-966a-a00c23b81bf5 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.294065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16381-9e63-4900-966a-a00c23b81bf5 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.294065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16381-9e63-4900-966a-a00c23b81bf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.294528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d16381-9e63-4900-966a-a00c23b81bf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.294528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d16381-9e63-4900-966a-a00c23b81bf5 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.303034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1192/2346] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:33:37.260525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:37.263133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:37.381030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d50749-c604-40e7-83d5-9eab32eea3df None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:37.386627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:37.387306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:37.387637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:37.387926 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:37.390413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:37.406282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:37.408100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:37.419425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1155/2347] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:48.165012 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a6a9-9111-44c4-82fa-d49b31de2510 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:48.165531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a6a9-9111-44c4-82fa-d49b31de2510 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:48.165627 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a6a9-9111-44c4-82fa-d49b31de2510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:48.183545 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6698a6a9-9111-44c4-82fa-d49b31de2510 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:48.184755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6698a6a9-9111-44c4-82fa-d49b31de2510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:48.192194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1193/2348] 10.222.0.55 () {58 vars in 967 bytes} [Thu May 5 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:48.205040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:48.216892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd46d6d-f71f-4b31-a7c3-a679004bf122 service placement] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:48.222245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:48.222885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:48.223174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:48.223456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:48.232636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:48.234250 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:48.243380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1156/2349] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:33:48.434912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:48.436327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:48.436327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:48.453560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:48.454769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:48.462407 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1194/2350] 10.222.0.55 () {58 vars in 967 bytes} [Thu May 5 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:48.475950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:48.486566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba018ac-dec2-4f90-942d-f216ef244c90 service swift] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:48.491566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:48.492205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:48.492541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:48.492822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:48.500972 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:48.502564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:48.511158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1157/2351] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:33:51.688817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.690341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:51.757277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fbea1-7323-4827-ab91-1371b19e6af4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.761903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.762785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.763159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.763375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] PATH_INFO: `/v3/users/c552caed303e4f72b7121fc979cc302d` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.764609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c552caed303e4f72b7121fc979cc302d)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.766529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.987878 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c552caed303e4f72b7121fc979cc302d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.988553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c552caed303e4f72b7121fc979cc302d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.059947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c552caed303e4f72b7121fc979cc302d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.067232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c552caed303e4f72b7121fc979cc302d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.067887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8b95e2d1-432f-449a-bda5-ef261cb2dd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c552caed303e4f72b7121fc979cc302d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.085027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1195/2352] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:33:51 2022] DELETE /identity/v3/users/c552caed303e4f72b7121fc979cc302d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:52.324284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.336913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002921a4-b2d8-415e-b7b9-829d1984aa87 service swift] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:52.398703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:52.399594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.399882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.400151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] PATH_INFO: `/v3/projects/9163f7a2ccc347a391a3541778b4bdca` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.401340 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9163f7a2ccc347a391a3541778b4bdca)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:52.403245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:52.505191 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9163f7a2ccc347a391a3541778b4bdca', 'request_id': 'req-3868c3a7-8b2d-497a-906e-7253c4f0efba'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.511826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9163f7a2ccc347a391a3541778b4bdca', 'request_id': 'req-3868c3a7-8b2d-497a-906e-7253c4f0efba'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.567007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9163f7a2ccc347a391a3541778b4bdca', 'request_id': 'req-3868c3a7-8b2d-497a-906e-7253c4f0efba'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.577877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] The token cache is being invalidate because project 9163f7a2ccc347a391a3541778b4bdca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:52.578233 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.578855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-3868c3a7-8b2d-497a-906e-7253c4f0efba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.580447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1158/2353] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:33:52 2022] DELETE /identity/v3/projects/9163f7a2ccc347a391a3541778b4bdca => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:52.586032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ed49-22cd-4cfa-a9cb-9c77502de425 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.586325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ed49-22cd-4cfa-a9cb-9c77502de425 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.586603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ed49-22cd-4cfa-a9cb-9c77502de425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.606684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c0a8ed49-22cd-4cfa-a9cb-9c77502de425 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:52.609358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c0a8ed49-22cd-4cfa-a9cb-9c77502de425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:52.666981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1196/2354] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:52.674907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d4b6-34c1-4b90-b92b-0368d6de92dc None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.675204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d4b6-34c1-4b90-b92b-0368d6de92dc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.675520 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d4b6-34c1-4b90-b92b-0368d6de92dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.693741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8203d4b6-34c1-4b90-b92b-0368d6de92dc None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:52.695380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8203d4b6-34c1-4b90-b92b-0368d6de92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:52.703334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1159/2355] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:52.709532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8ed49-22cd-4cfa-a9cb-9c77502de425 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.732495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8ed49-22cd-4cfa-a9cb-9c77502de425 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:52.738757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:52.739444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.739758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.740041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.740790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:52.741101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:52.742775 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:52.756210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1197/2356] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:52.760643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203d4b6-34c1-4b90-b92b-0368d6de92dc None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.769821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203d4b6-34c1-4b90-b92b-0368d6de92dc None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:52.775074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:52.775757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.776040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.776312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.777003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:52.778874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:52.863667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1160/2357] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:33:52 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:52.865000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.875030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd5d0-3420-433b-9445-c41fa175ef30 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:52.929731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:52.930447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.930741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.931002 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.931843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:52.933759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.015697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1198/2358] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:33:52 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:53.022083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:53.035781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc5f7d-af7f-4274-9215-d7520d5174df admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.040484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.041152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.041438 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.041717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.042439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.044080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.055314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1161/2359] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:53.059787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:53.070960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eced01f-404f-4cad-84c3-2200b08fcbaa admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.075708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3442-136b-409b-84d4-e908ed84d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.076362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3442-136b-409b-84d4-e908ed84d5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.076650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3442-136b-409b-84d4-e908ed84d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.076924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3442-136b-409b-84d4-e908ed84d5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.077650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db3442-136b-409b-84d4-e908ed84d5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.079238 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db3442-136b-409b-84d4-e908ed84d5c2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.093787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1199/2360] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:53.098202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:53.110720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059a73-86bf-4e16-8a67-fde1180760e5 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.115404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.116281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.116564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.117366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] PATH_INFO: `/v3/projects/b3517e3421a24b4ba29a91216ca59f7f/users/6cf0a1b2c62945a68767651c87c2fa9a/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.132114 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3517e3421a24b4ba29a91216ca59f7f, user_id=6cf0a1b2c62945a68767651c87c2fa9a, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.134826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.224785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1162/2361] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:33:53 2022] PUT /identity/v3/projects/b3517e3421a24b4ba29a91216ca59f7f/users/6cf0a1b2c62945a68767651c87c2fa9a/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:53.234632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724eb21e-3801-4838-9e26-50b369b60457 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.234919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724eb21e-3801-4838-9e26-50b369b60457 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.235205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724eb21e-3801-4838-9e26-50b369b60457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.262040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-724eb21e-3801-4838-9e26-50b369b60457 None None] MFA Rules not processed for user `6cf0a1b2c62945a68767651c87c2fa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:53.263240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-724eb21e-3801-4838-9e26-50b369b60457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.324501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1200/2362] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:53.335355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:53.337175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.401481 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d919-eb34-43fd-974e-8fa4f7e89c2d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.405251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876f70-3dec-455b-ac8b-99f4da6afe6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.411717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f70-3dec-455b-ac8b-99f4da6afe6f service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.411717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f70-3dec-455b-ac8b-99f4da6afe6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.411717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f70-3dec-455b-ac8b-99f4da6afe6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.416118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876f70-3dec-455b-ac8b-99f4da6afe6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.417590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876f70-3dec-455b-ac8b-99f4da6afe6f service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.427858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1163/2363] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:56.526531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724eb21e-3801-4838-9e26-50b369b60457 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:56.586739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724eb21e-3801-4838-9e26-50b369b60457 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:56.591224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:56.592112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.592647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.592919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] PATH_INFO: `/v3/users/6cf0a1b2c62945a68767651c87c2fa9a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.594082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf0a1b2c62945a68767651c87c2fa9a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:56.596028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:56.770647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf0a1b2c62945a68767651c87c2fa9a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.771245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf0a1b2c62945a68767651c87c2fa9a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.813472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf0a1b2c62945a68767651c87c2fa9a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.821338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf0a1b2c62945a68767651c87c2fa9a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.822075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf0a1b2c62945a68767651c87c2fa9a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.839188 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1201/2364] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:33:56 2022] DELETE /identity/v3/users/6cf0a1b2c62945a68767651c87c2fa9a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:56.844237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.844727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.844844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.861814 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:56.863006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.920071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1164/2365] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:56.930277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:56.931701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.986872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32e547-6e45-4686-acd7-d5cb7810df6d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:56.990485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896134e-c7fd-4b58-8fad-9458b33e37cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:56.991117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896134e-c7fd-4b58-8fad-9458b33e37cc service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.991401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896134e-c7fd-4b58-8fad-9458b33e37cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.992240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896134e-c7fd-4b58-8fad-9458b33e37cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.001476 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896134e-c7fd-4b58-8fad-9458b33e37cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.002910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896134e-c7fd-4b58-8fad-9458b33e37cc service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.013445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1202/2366] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:57.388180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.390023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.405265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fa712-5ae7-4213-9476-f35d2736d5c9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.410169 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.411249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.411701 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.412098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] PATH_INFO: `/v3/projects/b3517e3421a24b4ba29a91216ca59f7f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.413777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3517e3421a24b4ba29a91216ca59f7f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.416097 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.528030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3517e3421a24b4ba29a91216ca59f7f', 'request_id': 'req-16cdc598-5c49-498b-a06c-e86449297d90'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.533988 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3517e3421a24b4ba29a91216ca59f7f', 'request_id': 'req-16cdc598-5c49-498b-a06c-e86449297d90'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.596428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3517e3421a24b4ba29a91216ca59f7f', 'request_id': 'req-16cdc598-5c49-498b-a06c-e86449297d90'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.607150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] The token cache is being invalidate because project b3517e3421a24b4ba29a91216ca59f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:57.607378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.608036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-16cdc598-5c49-498b-a06c-e86449297d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.609586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1165/2367] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:33:57 2022] DELETE /identity/v3/projects/b3517e3421a24b4ba29a91216ca59f7f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:57.614714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff62b4-ed20-4ccb-9ad9-d55b6efbba75 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.615233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff62b4-ed20-4ccb-9ad9-d55b6efbba75 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.615442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff62b4-ed20-4ccb-9ad9-d55b6efbba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.634471 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e0ff62b4-ed20-4ccb-9ad9-d55b6efbba75 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:57.635707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e0ff62b4-ed20-4ccb-9ad9-d55b6efbba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.692825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1203/2368] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:57.702015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551637-fcf3-4db5-ae06-0ef00e2cf374 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.702307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551637-fcf3-4db5-ae06-0ef00e2cf374 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.702593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551637-fcf3-4db5-ae06-0ef00e2cf374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.721266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7d551637-fcf3-4db5-ae06-0ef00e2cf374 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:57.722487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7d551637-fcf3-4db5-ae06-0ef00e2cf374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.730463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1166/2369] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:57.734774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff62b4-ed20-4ccb-9ad9-d55b6efbba75 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.745166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff62b4-ed20-4ccb-9ad9-d55b6efbba75 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.749676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.750331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.750615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.750889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.751665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:57.751971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.754568 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.766819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1204/2370] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:57.771251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551637-fcf3-4db5-ae06-0ef00e2cf374 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.780616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551637-fcf3-4db5-ae06-0ef00e2cf374 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.785422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.786067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.786349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.786629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.787324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.789251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.865612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1167/2371] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:33:57 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:57.870287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.880200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf697a4-c132-49d8-99ba-97af9d507723 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.934925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.935620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.935903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.936186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.936880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.938966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.053675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1205/2372] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:33:57 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:58.058231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:58.068452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21698-2eeb-48c0-8346-1b141edd05aa admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.073144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.073795 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.074076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.074356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.075074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.076702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.086777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1168/2373] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:58.090654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:58.100731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546fd5c-1644-4467-b6dc-c40b1704b04b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.105819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10222324-2dd6-45f3-96c8-604629bb80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.106458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222324-2dd6-45f3-96c8-604629bb80c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.106740 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222324-2dd6-45f3-96c8-604629bb80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.107015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222324-2dd6-45f3-96c8-604629bb80c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.107768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10222324-2dd6-45f3-96c8-604629bb80c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.109347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10222324-2dd6-45f3-96c8-604629bb80c4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.119815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1206/2374] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:58.123831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:58.133716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d2281-c6a0-45af-a71e-f610ef48e6cf admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.138430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.139302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.139637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.139919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] PATH_INFO: `/v3/projects/fbee1a37bbff489e85a9d366fb34e8d4/users/2d89e1e4baa44cc0ad28c8dcaef5af76/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.155524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbee1a37bbff489e85a9d366fb34e8d4, user_id=2d89e1e4baa44cc0ad28c8dcaef5af76, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.158200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.225171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1169/2375] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:33:58 2022] PUT /identity/v3/projects/fbee1a37bbff489e85a9d366fb34e8d4/users/2d89e1e4baa44cc0ad28c8dcaef5af76/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:58.231181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154345-71b5-4656-a20a-95fcd84cc413 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.231497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154345-71b5-4656-a20a-95fcd84cc413 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.231800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154345-71b5-4656-a20a-95fcd84cc413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.249803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-46154345-71b5-4656-a20a-95fcd84cc413 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:58.250989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-46154345-71b5-4656-a20a-95fcd84cc413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:58.307489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1207/2376] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:58.317089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:58.318773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:58.378962 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ec32-dca1-4361-8429-5f5c98e08c88 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.382673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.383321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.383637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.383914 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.393770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.395203 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.405682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1170/2377] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:04.034930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3318c-1c9c-4401-a4d4-1df5112f5026 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:04.035507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3318c-1c9c-4401-a4d4-1df5112f5026 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:04.035507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3318c-1c9c-4401-a4d4-1df5112f5026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:04.064442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e0d3318c-1c9c-4401-a4d4-1df5112f5026 None None] MFA Rules not processed for user `2d89e1e4baa44cc0ad28c8dcaef5af76`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:04.065661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e0d3318c-1c9c-4401-a4d4-1df5112f5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:04.132468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1208/2378] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:34:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:04.136859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:04.146665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37428c5f-fbe9-4dd7-a979-8c477a149530 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:04.152767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:04.153527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:04.153884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:04.154426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:04.155204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:04.157417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:04.285098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1171/2379] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:34:04 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:04.289553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3318c-1c9c-4401-a4d4-1df5112f5026 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:04.302818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3318c-1c9c-4401-a4d4-1df5112f5026 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:04.370211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:04.370896 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:04.371178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:04.371578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:04.372295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:04.374312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:04.460585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1209/2380] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:34:04 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:34:04.472519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:04.484768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5319ca-b9a9-484d-a5d2-d0d1a4acb014 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:04.489463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:04.490135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:04.492718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:04.492718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:04.492718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:04.493643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:04.505997 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1172/2381] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:04.510526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:04.521959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055b6ac-d2b3-42a1-ac67-eebb30fd01d2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:04.527680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:04.528553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:04.528834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:04.529113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] PATH_INFO: `/v3/projects/07d596097386437da37801c01f06eb21/users/78e0b97ac10941b7a5cd721147d68232/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:04.556749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d596097386437da37801c01f06eb21, user_id=78e0b97ac10941b7a5cd721147d68232, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:04.559850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:04.625492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1210/2382] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:34:04 2022] PUT /identity/v3/projects/07d596097386437da37801c01f06eb21/users/78e0b97ac10941b7a5cd721147d68232/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:04.629456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:04.640646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969018d-0620-4849-b806-2a49ee95f0de admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:04.713805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f5107-ef52-4f8c-b445-180b7fb4097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:04.714503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5107-ef52-4f8c-b445-180b7fb4097c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:04.714796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5107-ef52-4f8c-b445-180b7fb4097c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:04.715071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5107-ef52-4f8c-b445-180b7fb4097c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:04.715867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f5107-ef52-4f8c-b445-180b7fb4097c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:04.717753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f5107-ef52-4f8c-b445-180b7fb4097c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:04.732485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1173/2383] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:04.734226 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:04.745201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eaf78-37ef-4d1a-92a7-650fed94eafc admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:04.752323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:04.753232 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:04.753516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:04.753793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] PATH_INFO: `/v3/projects/07d596097386437da37801c01f06eb21/users/78e0b97ac10941b7a5cd721147d68232/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:04.755874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d596097386437da37801c01f06eb21, user_id=78e0b97ac10941b7a5cd721147d68232, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:04.759130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:04.774972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1211/2384] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:34:04 2022] PUT /identity/v3/projects/07d596097386437da37801c01f06eb21/users/78e0b97ac10941b7a5cd721147d68232/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:11.697498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dd30e-1bda-4c1d-ba03-56fa82fbda05 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:11.698103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dd30e-1bda-4c1d-ba03-56fa82fbda05 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:11.698103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dd30e-1bda-4c1d-ba03-56fa82fbda05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:11.769407 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-7b6dd30e-1bda-4c1d-ba03-56fa82fbda05 None None] MFA Rules not processed for user `78e0b97ac10941b7a5cd721147d68232`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:11.771028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7b6dd30e-1bda-4c1d-ba03-56fa82fbda05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:11.884524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1174/2385] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:34:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:11.896669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:11.899863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:12.011587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e23dcc-9900-4e69-85f4-a349618db87e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:12.023744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301f1ee-a27a-4f68-93f5-a3b770720166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:12.024772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f1ee-a27a-4f68-93f5-a3b770720166 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:12.025281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f1ee-a27a-4f68-93f5-a3b770720166 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:12.025707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f1ee-a27a-4f68-93f5-a3b770720166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:12.142710 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301f1ee-a27a-4f68-93f5-a3b770720166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:12.144484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301f1ee-a27a-4f68-93f5-a3b770720166 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:12.172777 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1212/2386] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:34:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:21.952987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3045-a959-442a-87db-aee55986e00e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:21.957530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3045-a959-442a-87db-aee55986e00e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:21.957530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3045-a959-442a-87db-aee55986e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:21.971137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-18bf3045-a959-442a-87db-aee55986e00e None None] MFA Rules not processed for user `2ca44c6702304a53a176bebdb6ccbe3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:21.972389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-18bf3045-a959-442a-87db-aee55986e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:22.031026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1175/2387] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:34:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:31.421067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9257a-04cb-40fc-b5a9-732a3bdc6b1c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:31.421585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9257a-04cb-40fc-b5a9-732a3bdc6b1c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:31.421684 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9257a-04cb-40fc-b5a9-732a3bdc6b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:31.438606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e6e9257a-04cb-40fc-b5a9-732a3bdc6b1c None None] MFA Rules not processed for user `2d89e1e4baa44cc0ad28c8dcaef5af76`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:31.439815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e6e9257a-04cb-40fc-b5a9-732a3bdc6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:31.446686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1213/2388] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:34:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:34.974012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfea6-701e-4a53-9d45-fdba696631d6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:34.974567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfea6-701e-4a53-9d45-fdba696631d6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:34.974567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfea6-701e-4a53-9d45-fdba696631d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:34.991655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-2cddfea6-701e-4a53-9d45-fdba696631d6 None None] MFA Rules not processed for user `68239e70245a4922b8c7961dd8962baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:34.992865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2cddfea6-701e-4a53-9d45-fdba696631d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:35.050579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1176/2389] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:35.774850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:35.775372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:35.776184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:35.800910 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] MFA Rules not processed for user `65b7373b2c664dc4a054b8943d1d231c`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:35.803970 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:35.864257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1214/2390] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:53.905751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddfea6-701e-4a53-9d45-fdba696631d6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:53.962609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddfea6-701e-4a53-9d45-fdba696631d6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:53.966617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:53.967266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:53.967718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:53.968006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:53.977621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:53.981661 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:53.988662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1177/2391] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:34:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:37.072409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:37.073836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:37.085791 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be5fb-8fed-4825-af45-56711d940a8b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:37.089490 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:37.090400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:37.090677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:37.090954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:37.092731 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:37.107994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:37.148559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:37.148559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1215/2392] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:38.301992 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:38.314157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bb21e-462f-455d-b789-7c3452b96cd5 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:38.317924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:38.318577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.318862 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.319143 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.321020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:38.359092 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:38.362077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:38.394109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1178/2393] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:39.523253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.534163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79da1f-2b15-46fa-9984-908edad8fdd7 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.542450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738276ac-3e85-4bee-b11c-c4aabcba0d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.542450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738276ac-3e85-4bee-b11c-c4aabcba0d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.542450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738276ac-3e85-4bee-b11c-c4aabcba0d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.542450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738276ac-3e85-4bee-b11c-c4aabcba0d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.543043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-738276ac-3e85-4bee-b11c-c4aabcba0d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:39.617299 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738276ac-3e85-4bee-b11c-c4aabcba0d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.618814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738276ac-3e85-4bee-b11c-c4aabcba0d1b service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.631242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1216/2394] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:44.075932 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:44.077582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:44.091616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0befeff-a795-4144-b454-e77c0f33469a service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:44.096782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:44.097654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:44.097931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:44.098201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] PATH_INFO: `/v3/users/68239e70245a4922b8c7961dd8962baa` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:44.099397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68239e70245a4922b8c7961dd8962baa)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:44.101359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:44.339804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68239e70245a4922b8c7961dd8962baa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:44.346873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68239e70245a4922b8c7961dd8962baa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:44.422981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68239e70245a4922b8c7961dd8962baa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:44.436690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68239e70245a4922b8c7961dd8962baa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:44.443403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68239e70245a4922b8c7961dd8962baa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:44.444329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1179/2395] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:35:44 2022] DELETE /identity/v3/users/68239e70245a4922b8c7961dd8962baa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:44.848757 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d80b-6bbd-4cb2-a472-d40eed465523 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:44.849342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d80b-6bbd-4cb2-a472-d40eed465523 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:44.849342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d80b-6bbd-4cb2-a472-d40eed465523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:44.866774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-51f7d80b-6bbd-4cb2-a472-d40eed465523 None None] MFA Rules not processed for user `2ca44c6702304a53a176bebdb6ccbe3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:44.868097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-51f7d80b-6bbd-4cb2-a472-d40eed465523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:44.898935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:44.901023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:44.927357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1217/2396] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:35:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:44.981581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854a418-6fa9-4c58-8621-7c24e930b42f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:44.986579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:44.987698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:44.987981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:44.988253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] PATH_INFO: `/v3/projects/432804d7e09449b69b0ce11c92fe4240` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:44.989476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432804d7e09449b69b0ce11c92fe4240)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:44.991419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.107985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432804d7e09449b69b0ce11c92fe4240', 'request_id': 'req-a32b4c16-0ff2-4f8d-9225-71884f549298'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:45.117729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432804d7e09449b69b0ce11c92fe4240', 'request_id': 'req-a32b4c16-0ff2-4f8d-9225-71884f549298'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:45.187955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432804d7e09449b69b0ce11c92fe4240', 'request_id': 'req-a32b4c16-0ff2-4f8d-9225-71884f549298'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:45.199933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] The token cache is being invalidate because project 432804d7e09449b69b0ce11c92fe4240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:45.200230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:45.201011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a32b4c16-0ff2-4f8d-9225-71884f549298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:45.202873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1180/2397] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:35:44 2022] DELETE /identity/v3/projects/432804d7e09449b69b0ce11c92fe4240 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:45.208208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516128-28e0-43ee-8511-87bc40471ae6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.208660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516128-28e0-43ee-8511-87bc40471ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.209026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516128-28e0-43ee-8511-87bc40471ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.228804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5a516128-28e0-43ee-8511-87bc40471ae6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:45.230116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5a516128-28e0-43ee-8511-87bc40471ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:45.291399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1218/2398] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:45.299006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe789-8093-4a45-9245-f797b0e409cf None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.299305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe789-8093-4a45-9245-f797b0e409cf None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.299623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe789-8093-4a45-9245-f797b0e409cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.318277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bacfe789-8093-4a45-9245-f797b0e409cf None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:45.319547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bacfe789-8093-4a45-9245-f797b0e409cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:45.328321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1181/2399] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:45.332322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516128-28e0-43ee-8511-87bc40471ae6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.343161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516128-28e0-43ee-8511-87bc40471ae6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.347908 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.348594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.348873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.349143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.349865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:45.350165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.351804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.363512 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1219/2400] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:35:45.367813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfe789-8093-4a45-9245-f797b0e409cf None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.377128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfe789-8093-4a45-9245-f797b0e409cf None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.381892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.382543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.382831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.383123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.384386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.386260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.497154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1182/2401] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:35:45 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:45.498395 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.509284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d9fdf-5561-4b60-84eb-3a19c7afc32e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.564305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.564979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.565269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.565551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.566236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.568202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.620433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.622142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:45.646093 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1220/2402] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:35:45 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:45.655369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.673705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f238e-22a3-40a2-bb5c-b9ea7cdb94cb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.673705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.673705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.673705 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.674121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.674121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.674722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.685622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1221/2403] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:45.689527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.700026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a4fd-d179-4a08-aeb1-07b1b6fbbe20 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.704800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.705485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.705758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0989-a528-4d64-8542-b2db776827e9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.705885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.706148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.706872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.708564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.712194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a60c8-2508-4a58-99d1-5ef9f31f4333 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.712860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a60c8-2508-4a58-99d1-5ef9f31f4333 service placement] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.713196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a60c8-2508-4a58-99d1-5ef9f31f4333 service placement] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.713464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a60c8-2508-4a58-99d1-5ef9f31f4333 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.716089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f67a60c8-2508-4a58-99d1-5ef9f31f4333 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:45.719861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1222/2404] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:35:45.723941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.728779 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a60c8-2508-4a58-99d1-5ef9f31f4333 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.730427 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a60c8-2508-4a58-99d1-5ef9f31f4333 service placement] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.734217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde3cfc-b395-466d-81ba-f148848ae7a6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.740024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.740940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.741216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.741705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1183/2405] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:45.743677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] PATH_INFO: `/v3/projects/5d93ed256d64460ca78ab0593d417fb1/users/5f3bb238d5b3405e8e7e5eb557edf4c6/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.759743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d93ed256d64460ca78ab0593d417fb1, user_id=5f3bb238d5b3405e8e7e5eb557edf4c6, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.762449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.832462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1223/2406] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:35:45 2022] PUT /identity/v3/projects/5d93ed256d64460ca78ab0593d417fb1/users/5f3bb238d5b3405e8e7e5eb557edf4c6/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:45.841042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.841042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.841042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.858794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:45.860088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:45.927937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1184/2407] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:45.940283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.942396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:46.004761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cc234-686f-4cdd-bc9a-79e18b38bd82 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:46.008466 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:46.009658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:46.009937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:46.010214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:46.019855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:46.021319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:46.032329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1224/2408] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:50.041879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:50.044176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:50.133154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02265f-c66c-4c2f-acf2-346ea1d717a6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:50.139982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c500c-e9c5-4c68-9e28-0d2208bc36a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:50.141944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c500c-e9c5-4c68-9e28-0d2208bc36a6 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:50.141944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c500c-e9c5-4c68-9e28-0d2208bc36a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:50.141944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c500c-e9c5-4c68-9e28-0d2208bc36a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:50.143870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-810c500c-e9c5-4c68-9e28-0d2208bc36a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:50.222667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c500c-e9c5-4c68-9e28-0d2208bc36a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:50.224345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c500c-e9c5-4c68-9e28-0d2208bc36a6 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:50.240417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1185/2409] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:50.949630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:50.951762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:50.965502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a990-33bf-4d61-a7ab-36c638fd33d0 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:50.971177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:50.972202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:50.972677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:50.973175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:50.975558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:50.997389 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:51.000631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:51.013169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1225/2410] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:53.091949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7f7f-851e-4ccd-9f5d-952bd22852fa None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:53.092450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7f7f-851e-4ccd-9f5d-952bd22852fa None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:53.092549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7f7f-851e-4ccd-9f5d-952bd22852fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:53.118762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e1ac7f7f-851e-4ccd-9f5d-952bd22852fa None None] MFA Rules not processed for user `5f3bb238d5b3405e8e7e5eb557edf4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:53.120012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e1ac7f7f-851e-4ccd-9f5d-952bd22852fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:53.188286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1186/2411] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:35:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:53.200155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:53.213439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae3a7-686f-4978-a7c7-a37c77c71544 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:53.219434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:53.220240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:53.220531 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:53.220842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:53.229579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:53.231166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:53.240999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1226/2412] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:56.433563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c8cd-5008-4c8f-a77e-c07385308e46 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:56.434157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c8cd-5008-4c8f-a77e-c07385308e46 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:56.434422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c8cd-5008-4c8f-a77e-c07385308e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:56.455004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-d0f3c8cd-5008-4c8f-a77e-c07385308e46 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:56.457641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d0f3c8cd-5008-4c8f-a77e-c07385308e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:56.539244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1187/2413] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:56.745808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:56.746516 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519b1d-12ee-4112-b223-0da05675e2ad None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:56.747025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519b1d-12ee-4112-b223-0da05675e2ad None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:56.747263 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519b1d-12ee-4112-b223-0da05675e2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:56.747701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:56.772383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-86519b1d-12ee-4112-b223-0da05675e2ad None None] MFA Rules not processed for user `5f3bb238d5b3405e8e7e5eb557edf4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:56.775811 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-86519b1d-12ee-4112-b223-0da05675e2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:56.784584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1188/2414] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:56.838679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb2449-ff0d-41b6-a1c8-243644e8e4f0 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:56.844921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:56.845358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:56.845640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:56.845944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:56.856263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:56.857866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:56.870155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1227/2415] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:35:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:35:57.225236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86519b1d-12ee-4112-b223-0da05675e2ad None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:57.236665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86519b1d-12ee-4112-b223-0da05675e2ad None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:57.240995 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:57.241691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:57.241980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:57.243129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:57.245065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:57.257195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:57.259226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:57.271951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1189/2416] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:35:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:00.297965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:00.312659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d399-aab5-4f88-8ae9-d3616ac08df7 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:00.324950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:00.326244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:00.326591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:00.326941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:00.329009 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:00.402054 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:00.404980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:00.415528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1228/2417] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:36:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:36:03.290518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:03.292674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:03.383561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb934a2d-eec3-4d23-b654-004dc2e4e0ba service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:03.392410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:03.393436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:03.393882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:03.394377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:03.402005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:03.418824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:03.426938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:03.455058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1190/2418] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:36:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:14.645538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:14.657446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e39fd-ca46-41c2-a579-e66e21d3cef0 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:14.662992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435238-460f-4605-8d7b-b61acf9410b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:14.663669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435238-460f-4605-8d7b-b61acf9410b3 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:14.670382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435238-460f-4605-8d7b-b61acf9410b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:14.670382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435238-460f-4605-8d7b-b61acf9410b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:14.670382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-73435238-460f-4605-8d7b-b61acf9410b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:14.678470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435238-460f-4605-8d7b-b61acf9410b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:14.680096 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435238-460f-4605-8d7b-b61acf9410b3 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:14.691264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1229/2419] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:36:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:16.085419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:16.095719 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68025acb-d70f-47a6-b5c3-a70f80e7d906 service nova] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:16.099366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:16.100056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:16.100346 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:16.100625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:16.102389 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:16.112109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:16.113614 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:16.121700 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1191/2420] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:36:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:18.726439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3475-92bf-417d-aa21-cb2414e238ab None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:18.726929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3475-92bf-417d-aa21-cb2414e238ab None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:18.727043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3475-92bf-417d-aa21-cb2414e238ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:18.745482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-87ec3475-92bf-417d-aa21-cb2414e238ab None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:18.747254 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-87ec3475-92bf-417d-aa21-cb2414e238ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:18.754986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1230/2421] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:36:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:18.769859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:18.782335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e06a-b614-41ac-8a0c-a9f578c03dbe service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:18.787643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:18.788285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:18.788570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:18.788854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:18.797228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:18.798794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:18.807449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1192/2422] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:36:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:36:34.853586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9064be-fab4-4148-835a-e09a53b88798 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:34.854121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9064be-fab4-4148-835a-e09a53b88798 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:34.854121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9064be-fab4-4148-835a-e09a53b88798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:34.872209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3d9064be-fab4-4148-835a-e09a53b88798 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:34.873385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3d9064be-fab4-4148-835a-e09a53b88798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:34.881385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1231/2423] 10.222.0.55 () {58 vars in 967 bytes} [Thu May 5 15:36:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:34.893494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:34.903646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a0dc8-3785-4f90-8a57-7bef4cb207d6 service swift] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:34.908840 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a2351-d262-40fe-87ee-aca67db1b219 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:34.909479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a2351-d262-40fe-87ee-aca67db1b219 service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:34.909762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a2351-d262-40fe-87ee-aca67db1b219 service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:34.910051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a2351-d262-40fe-87ee-aca67db1b219 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:34.918168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a2351-d262-40fe-87ee-aca67db1b219 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:34.919767 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a2351-d262-40fe-87ee-aca67db1b219 service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:34.928158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1193/2424] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:36:53.772416 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9064be-fab4-4148-835a-e09a53b88798 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:53.794163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9064be-fab4-4148-835a-e09a53b88798 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:53.801938 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:53.803066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:53.803583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:53.804056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:53.806360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:53.821372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:53.823555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:53.837645 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1232/2425] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:36:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:00.072934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:00.073512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:00.073512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:00.094786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] MFA Rules not processed for user `2d89e1e4baa44cc0ad28c8dcaef5af76`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:00.096098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:00.155049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1194/2426] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:01.199180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:01.210613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519925-a4b1-42a5-a4da-2b9d8a561804 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:01.216393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:01.217502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:01.218016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:01.218505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:01.221525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:01.238080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:01.240291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:01.263783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1233/2427] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:06.214797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:06.216319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:06.229900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f569f-5ca4-4eb2-8f91-2f451af366d8 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:06.234479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:06.235891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:06.236176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:06.236449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] PATH_INFO: `/v3/users/2ca44c6702304a53a176bebdb6ccbe3f` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:06.237645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca44c6702304a53a176bebdb6ccbe3f)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:06.239591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:06.511796 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca44c6702304a53a176bebdb6ccbe3f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:06.521442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca44c6702304a53a176bebdb6ccbe3f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:06.599860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca44c6702304a53a176bebdb6ccbe3f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:06.615412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca44c6702304a53a176bebdb6ccbe3f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:06.616727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-8b199951-8b41-434b-85f3-186694283fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca44c6702304a53a176bebdb6ccbe3f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:06.623691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1195/2428] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:06 2022] DELETE /identity/v3/users/2ca44c6702304a53a176bebdb6ccbe3f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:06.870586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:06.882591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54063dbc-a137-498f-b4c5-1ce32bdb6d02 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:06.947023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:06.947934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:06.948219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:06.948646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] PATH_INFO: `/v3/projects/cf5faa51bd0c4b3584365948ad227668` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:06.950113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5faa51bd0c4b3584365948ad227668)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:06.952065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:07.088445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5faa51bd0c4b3584365948ad227668', 'request_id': 'req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:07.095947 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5faa51bd0c4b3584365948ad227668', 'request_id': 'req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:07.150635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5faa51bd0c4b3584365948ad227668', 'request_id': 'req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:07.164309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] The token cache is being invalidate because project cf5faa51bd0c4b3584365948ad227668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:07.164456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:07.165135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4eb574e4-da9a-4c37-9d5b-ad6ed4440fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:07.166936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1234/2429] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:06 2022] DELETE /identity/v3/projects/cf5faa51bd0c4b3584365948ad227668 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:07.175077 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ba71-2430-41d9-93d1-01429c930441 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.175375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ba71-2430-41d9-93d1-01429c930441 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.175694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ba71-2430-41d9-93d1-01429c930441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.193912 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-cd98ba71-2430-41d9-93d1-01429c930441 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:07.195141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-cd98ba71-2430-41d9-93d1-01429c930441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:07.267573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1196/2430] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:37:07.274573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1549-b1ea-412d-8ea7-ee6e42b4f635 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.275075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1549-b1ea-412d-8ea7-ee6e42b4f635 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.275204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1549-b1ea-412d-8ea7-ee6e42b4f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.305265 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d74c1549-b1ea-412d-8ea7-ee6e42b4f635 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:07.306788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d74c1549-b1ea-412d-8ea7-ee6e42b4f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:07.315792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1235/2431] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:07.319624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ba71-2430-41d9-93d1-01429c930441 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:07.331175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ba71-2430-41d9-93d1-01429c930441 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:07.335864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:07.336497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.336785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.337066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.338199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:37:07.338682 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:07.340739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:07.354586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1197/2432] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:37:07.358863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1549-b1ea-412d-8ea7-ee6e42b4f635 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:07.368894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1549-b1ea-412d-8ea7-ee6e42b4f635 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:07.375137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:07.376372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.376906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.377194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.377890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:07.380187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:07.501375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1236/2433] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:07 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:07.506222 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:07.527046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1c14-43f9-4e89-8656-95b0f8f2e7d9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:07.583752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:07.584447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.584738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.585022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.585728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:07.587782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:07.691785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1198/2434] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:07 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:07.695762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:07.706637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd751-7e80-4fb7-bd86-19d641af738b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:07.711300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:07.712284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.712284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.712577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.713534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:07.715134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:07.725394 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1237/2435] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:07.729405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:07.740539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54853f-38dd-4485-a925-2eb91a7d6883 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:07.745894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7af694-c60e-4336-bc52-908b2cad331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:07.746573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7af694-c60e-4336-bc52-908b2cad331c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.746859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7af694-c60e-4336-bc52-908b2cad331c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.747137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7af694-c60e-4336-bc52-908b2cad331c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.747940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7af694-c60e-4336-bc52-908b2cad331c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:07.749693 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7af694-c60e-4336-bc52-908b2cad331c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:07.760782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1199/2436] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:07.765043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:07.775076 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d3a4-bdb0-4fe6-a35b-07d15eddd9f1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:07.779720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:07.780598 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.780888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.781155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] PATH_INFO: `/v3/projects/5b9bdb618d30479e8110f764a7a32f8d/users/eb2c4fd507df4736a7a8f182c7ee1066/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.795772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9bdb618d30479e8110f764a7a32f8d, user_id=eb2c4fd507df4736a7a8f182c7ee1066, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:07.798991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:07.878006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1238/2437] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:07 2022] PUT /identity/v3/projects/5b9bdb618d30479e8110f764a7a32f8d/users/eb2c4fd507df4736a7a8f182c7ee1066/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:07.887984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f71b78-9316-4052-8631-a126fbd29825 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:07.888364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f71b78-9316-4052-8631-a126fbd29825 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:07.888781 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f71b78-9316-4052-8631-a126fbd29825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:07.914922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-58f71b78-9316-4052-8631-a126fbd29825 None None] MFA Rules not processed for user `eb2c4fd507df4736a7a8f182c7ee1066`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:07.916171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-58f71b78-9316-4052-8631-a126fbd29825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:07.978053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1200/2438] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:07.982390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.041713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695e222-98f8-40c0-b3cb-cf793f879fee admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.046400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.047052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.047336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.048141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.048824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:08.050730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:08.129418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1239/2439] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:07 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:08.133429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f71b78-9316-4052-8631-a126fbd29825 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.143956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f71b78-9316-4052-8631-a126fbd29825 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.198590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.199256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.199574 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.199855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.200548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:08.202449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:08.292660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1201/2440] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:08 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:08.301326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.311721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0fc07-77fc-4dd4-b471-b31cd958e680 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.316741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.317445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.317734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.318006 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.318765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:08.320436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:08.336302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1240/2441] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:08.346605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.356858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be05f0-3c73-492a-946e-f319ca9a83b2 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.362642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.363564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.363853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.364131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] PATH_INFO: `/v3/projects/9a2f209533ce48679bc5efd78f0f3744/users/3c54b0adc754430aaac668e209312a0f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.379351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2f209533ce48679bc5efd78f0f3744, user_id=3c54b0adc754430aaac668e209312a0f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:08.382086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:08.455189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1202/2442] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:08 2022] PUT /identity/v3/projects/9a2f209533ce48679bc5efd78f0f3744/users/3c54b0adc754430aaac668e209312a0f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:37:08.459335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.469697 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56159ee-c2c9-4571-a0d0-1b69cf1fcc40 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.525298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f548-5121-48a8-b36c-8711c646fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.525882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f548-5121-48a8-b36c-8711c646fbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.526168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f548-5121-48a8-b36c-8711c646fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.526454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f548-5121-48a8-b36c-8711c646fbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.527169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f548-5121-48a8-b36c-8711c646fbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:08.528804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f548-5121-48a8-b36c-8711c646fbc0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:08.542517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1241/2443] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:08.543419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.554349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16596207-84c9-4b90-938d-ec6c35e17a2c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.559152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.560091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.560406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.560711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] PATH_INFO: `/v3/projects/9a2f209533ce48679bc5efd78f0f3744/users/3c54b0adc754430aaac668e209312a0f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.562684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2f209533ce48679bc5efd78f0f3744, user_id=3c54b0adc754430aaac668e209312a0f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:08.565975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:08.576568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1203/2444] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:08 2022] PUT /identity/v3/projects/9a2f209533ce48679bc5efd78f0f3744/users/3c54b0adc754430aaac668e209312a0f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:08.588183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824d2ac-6a6d-492e-83d8-cb885e1cec6c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.588497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824d2ac-6a6d-492e-83d8-cb885e1cec6c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.588920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824d2ac-6a6d-492e-83d8-cb885e1cec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.615591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a824d2ac-6a6d-492e-83d8-cb885e1cec6c None None] MFA Rules not processed for user `3c54b0adc754430aaac668e209312a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:08.616903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a824d2ac-6a6d-492e-83d8-cb885e1cec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:08.694379 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1242/2445] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:08.706695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.708430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:08.772214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795946c-f816-459b-99bb-a6cdc4127ce4 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.775958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.776536 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.776832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.777098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:08.786317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:08.787768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:08.797139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1204/2446] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:37:08.977832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824d2ac-6a6d-492e-83d8-cb885e1cec6c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:08.988255 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824d2ac-6a6d-492e-83d8-cb885e1cec6c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:08.991793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a95dd-0d6a-4713-b0ff-da95fc180b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:08.992475 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a95dd-0d6a-4713-b0ff-da95fc180b24 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:08.992755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a95dd-0d6a-4713-b0ff-da95fc180b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:08.993194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a95dd-0d6a-4713-b0ff-da95fc180b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:09.047833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a95dd-0d6a-4713-b0ff-da95fc180b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:09.049184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a95dd-0d6a-4713-b0ff-da95fc180b24 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:09.058071 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1243/2447] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:20.196565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:20.260053 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe7edc-fe2d-434e-96d5-157faa2188a1 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:20.266498 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:20.267405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:20.267721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:20.268000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] PATH_INFO: `/v3/users/eb2c4fd507df4736a7a8f182c7ee1066` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:20.269311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2c4fd507df4736a7a8f182c7ee1066)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:20.271254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:20.517308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2c4fd507df4736a7a8f182c7ee1066'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:20.524679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2c4fd507df4736a7a8f182c7ee1066'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:20.647929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2c4fd507df4736a7a8f182c7ee1066'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:20.660338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2c4fd507df4736a7a8f182c7ee1066'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:20.661026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2c4fd507df4736a7a8f182c7ee1066'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:20.667375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1205/2448] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:20 2022] DELETE /identity/v3/users/eb2c4fd507df4736a7a8f182c7ee1066 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:20.671959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:20.673175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:20.673175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:20.691329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:20.692632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:20.757337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1244/2449] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:20.766918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:20.768499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:20.828665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed71fd-9db8-4902-b76e-c18bb00a1bd9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:20.834681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:20.834681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:20.834681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:20.834681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:20.842909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:20.844959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:20.855111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1206/2450] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:21.027306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:21.028762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:21.042125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d61c5-0901-44b9-ae04-f1789993e646 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:21.045960 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:21.046650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:21.047189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:21.048633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:21.053378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:21.063427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:21.064940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:21.075251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1245/2451] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:22.102140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:22.103888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:22.116521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ed5b-1cfc-4905-80b9-4fe2c719d768 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:22.121286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:22.122146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:22.122432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:22.122713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] PATH_INFO: `/v3/projects/5b9bdb618d30479e8110f764a7a32f8d` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:22.123949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9bdb618d30479e8110f764a7a32f8d)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:22.125986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:22.242652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9bdb618d30479e8110f764a7a32f8d', 'request_id': 'req-0ae555ad-c419-4f29-a65f-c20da141b52b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.248984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9bdb618d30479e8110f764a7a32f8d', 'request_id': 'req-0ae555ad-c419-4f29-a65f-c20da141b52b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.302141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9bdb618d30479e8110f764a7a32f8d', 'request_id': 'req-0ae555ad-c419-4f29-a65f-c20da141b52b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.313794 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] The token cache is being invalidate because project 5b9bdb618d30479e8110f764a7a32f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:22.314090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.314999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.316791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1207/2452] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:22 2022] DELETE /identity/v3/projects/5b9bdb618d30479e8110f764a7a32f8d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:22.321031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:22.331799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483648fb-d382-4636-a13b-e59f6861a08b service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:22.389204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:22.389981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:22.390322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:22.390616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] PATH_INFO: `/v3/users/3c54b0adc754430aaac668e209312a0f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:22.392616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c54b0adc754430aaac668e209312a0f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:22.394564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:22.613171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c54b0adc754430aaac668e209312a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.614083 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c54b0adc754430aaac668e209312a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.690832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c54b0adc754430aaac668e209312a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.698526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c54b0adc754430aaac668e209312a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.699252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbaa273e-5a0f-44f5-875d-5e084a669bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c54b0adc754430aaac668e209312a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:22.718281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1246/2453] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:22 2022] DELETE /identity/v3/users/3c54b0adc754430aaac668e209312a0f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:23.152119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:23.153768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:23.175549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae555ad-c419-4f29-a65f-c20da141b52b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:23.232409 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:23.233195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.233485 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.233766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] PATH_INFO: `/v3/projects/9a2f209533ce48679bc5efd78f0f3744` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.235627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2f209533ce48679bc5efd78f0f3744)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:23.237585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:23.357219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2f209533ce48679bc5efd78f0f3744', 'request_id': 'req-ff230eda-9517-41fe-ae79-2041e2b2e790'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:23.363967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2f209533ce48679bc5efd78f0f3744', 'request_id': 'req-ff230eda-9517-41fe-ae79-2041e2b2e790'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:23.447858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2f209533ce48679bc5efd78f0f3744', 'request_id': 'req-ff230eda-9517-41fe-ae79-2041e2b2e790'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:23.458673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] The token cache is being invalidate because project 9a2f209533ce48679bc5efd78f0f3744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:23.458961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:23.459833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ff230eda-9517-41fe-ae79-2041e2b2e790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:23.464980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1208/2454] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:23 2022] DELETE /identity/v3/projects/9a2f209533ce48679bc5efd78f0f3744 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:23.466693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdd484-0a22-4dab-85e6-c31a078de67e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.467147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdd484-0a22-4dab-85e6-c31a078de67e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.467293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdd484-0a22-4dab-85e6-c31a078de67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.494162 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7acdd484-0a22-4dab-85e6-c31a078de67e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:23.495629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7acdd484-0a22-4dab-85e6-c31a078de67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:23.557707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1247/2455] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:37:23.565448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fefeb8-b42e-42a8-a351-10036a28d6c6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.565916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fefeb8-b42e-42a8-a351-10036a28d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.566202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fefeb8-b42e-42a8-a351-10036a28d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.585039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a9fefeb8-b42e-42a8-a351-10036a28d6c6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:23.586285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a9fefeb8-b42e-42a8-a351-10036a28d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:23.595127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1209/2456] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:37:23.599345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdd484-0a22-4dab-85e6-c31a078de67e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:23.609038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdd484-0a22-4dab-85e6-c31a078de67e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:23.614293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:23.614955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.615239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.615538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.616267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:37:23.616571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:23.618167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:23.630847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1248/2457] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:37:23.635144 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fefeb8-b42e-42a8-a351-10036a28d6c6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:23.644691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fefeb8-b42e-42a8-a351-10036a28d6c6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:23.649411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:23.650086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.650375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.650656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.651367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:23.653311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:23.763595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1210/2458] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:23 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:23.764838 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:23.775929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8806-a3ae-451f-bb32-497408bc50b6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:23.832646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:23.833553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.833934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.834375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.835083 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:23.837996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:23.913986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1249/2459] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:23 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:37:23.915378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:23.925744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fc2c0-b3e2-44cc-b263-d4d114cb7775 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:23.930607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:23.931308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.931698 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.931974 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.932725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:23.934327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:23.946265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1211/2460] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:23.950318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:23.961467 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db5011-111c-4f81-b3c1-729cfb42e3ce admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:23.966668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66072032-9267-4f01-bca1-338eb6569fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:23.967339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66072032-9267-4f01-bca1-338eb6569fff admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:23.967655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66072032-9267-4f01-bca1-338eb6569fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:23.967931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66072032-9267-4f01-bca1-338eb6569fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:23.969089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66072032-9267-4f01-bca1-338eb6569fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:23.970717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66072032-9267-4f01-bca1-338eb6569fff admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:23.984483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1250/2461] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:37:23.985938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:23.996605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2e54-21e3-4ece-9b01-8022e4d2cc1c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:24.001775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:24.002954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.003244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.003547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] PATH_INFO: `/v3/projects/8e1a38f352ba409b952bf5f2792b9b63/users/2c2fe7a0459d43e5902c716f5f67b2f9/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.024064 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1a38f352ba409b952bf5f2792b9b63, user_id=2c2fe7a0459d43e5902c716f5f67b2f9, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:24.024518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:24.094335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1212/2462] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:23 2022] PUT /identity/v3/projects/8e1a38f352ba409b952bf5f2792b9b63/users/2c2fe7a0459d43e5902c716f5f67b2f9/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:24.104640 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b3c1-a525-4307-aa1b-60d58b27ad30 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.104937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b3c1-a525-4307-aa1b-60d58b27ad30 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.105224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b3c1-a525-4307-aa1b-60d58b27ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.132129 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e911b3c1-a525-4307-aa1b-60d58b27ad30 None None] MFA Rules not processed for user `2c2fe7a0459d43e5902c716f5f67b2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:24.133411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e911b3c1-a525-4307-aa1b-60d58b27ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:24.207979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1251/2463] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:24.214802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:24.285100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718a33-caa5-4deb-8127-212cac186c9b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:24.291322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:24.292849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.293033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.293305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.294021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:24.296375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:24.386953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1213/2464] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:24 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:24.391120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b3c1-a525-4307-aa1b-60d58b27ad30 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:24.402927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b3c1-a525-4307-aa1b-60d58b27ad30 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:24.460038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:24.460633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.460923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.461353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.462042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:24.464347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:24.576723 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1252/2465] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:24 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:24.582662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:24.591624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945fe4-d55b-41db-997b-25e24533a246 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:24.596726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:24.597384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.597662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.597968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.598687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:24.600359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:24.615935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1214/2466] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:24.617167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:24.627779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ba4d-0de8-419f-87cd-a46cfe4d11a1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:24.632586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:24.633488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.633774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.634057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] PATH_INFO: `/v3/projects/8cacc789f2ab45cca1a089ec3b6ed65d/users/30e2367ab92d4a65a71733983cf62d77/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.649563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cacc789f2ab45cca1a089ec3b6ed65d, user_id=30e2367ab92d4a65a71733983cf62d77, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:24.652301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:24.785539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1253/2467] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:24 2022] PUT /identity/v3/projects/8cacc789f2ab45cca1a089ec3b6ed65d/users/30e2367ab92d4a65a71733983cf62d77/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:24.787017 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:24.798535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e4713-bb6a-4977-88c7-a5ed512f9c03 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:24.864533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588d85d-486d-4a88-b7f0-199f24c85c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:24.866181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d85d-486d-4a88-b7f0-199f24c85c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.866181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d85d-486d-4a88-b7f0-199f24c85c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.866181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d85d-486d-4a88-b7f0-199f24c85c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.877065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588d85d-486d-4a88-b7f0-199f24c85c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:24.877065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588d85d-486d-4a88-b7f0-199f24c85c79 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:24.878763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1215/2468] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:24.882822 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:24.893718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dd38e-bc4f-42a9-88a8-afcdc70bc6c2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:24.899492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:24.900484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.900841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.901186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] PATH_INFO: `/v3/projects/8cacc789f2ab45cca1a089ec3b6ed65d/users/30e2367ab92d4a65a71733983cf62d77/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.903403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cacc789f2ab45cca1a089ec3b6ed65d, user_id=30e2367ab92d4a65a71733983cf62d77, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:24.906214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:24.931884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1254/2469] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:24 2022] PUT /identity/v3/projects/8cacc789f2ab45cca1a089ec3b6ed65d/users/30e2367ab92d4a65a71733983cf62d77/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:24.943585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:24.943987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:24.944479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:24.976360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] MFA Rules not processed for user `30e2367ab92d4a65a71733983cf62d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:24.977942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:25.133552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1216/2470] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:37:25.141535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:25.144099 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:25.256165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a886f-9cad-4870-b8f1-e9a7e7f8d111 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:25.268707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:25.270472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:25.270837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:25.271767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:25.347849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:25.349411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:25.363197 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1255/2471] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:27.559391 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:27.560884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:27.627121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ea6ee-63bc-45bd-bf63-7659d6f2514b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:27.631674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:27.632547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:27.632825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:27.633102 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] PATH_INFO: `/v3/users/65b7373b2c664dc4a054b8943d1d231c` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:27.634295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b7373b2c664dc4a054b8943d1d231c)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:27.636241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:27.832265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b7373b2c664dc4a054b8943d1d231c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:27.839430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b7373b2c664dc4a054b8943d1d231c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:27.921848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b7373b2c664dc4a054b8943d1d231c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:27.934800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b7373b2c664dc4a054b8943d1d231c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:27.935567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-85e065cf-46f3-4079-a3e4-840ae00d8605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b7373b2c664dc4a054b8943d1d231c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:27.944166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1217/2472] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:27 2022] DELETE /identity/v3/users/65b7373b2c664dc4a054b8943d1d231c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:28.243384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:28.255492 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26f04-6074-48c4-aae0-f53afcfc0327 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:28.314819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:28.316114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:28.316539 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:28.316936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] PATH_INFO: `/v3/projects/72f4e78cd69041eaa1f81b3ea4ed27d4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:28.318472 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f4e78cd69041eaa1f81b3ea4ed27d4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:28.321193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:28.586675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f4e78cd69041eaa1f81b3ea4ed27d4', 'request_id': 'req-82bfaff7-aac6-4b29-ad06-86616dd607cf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:28.593599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f4e78cd69041eaa1f81b3ea4ed27d4', 'request_id': 'req-82bfaff7-aac6-4b29-ad06-86616dd607cf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:28.662033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f4e78cd69041eaa1f81b3ea4ed27d4', 'request_id': 'req-82bfaff7-aac6-4b29-ad06-86616dd607cf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:28.673423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] The token cache is being invalidate because project 72f4e78cd69041eaa1f81b3ea4ed27d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:28.673703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:28.674345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-82bfaff7-aac6-4b29-ad06-86616dd607cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:28.675933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1256/2473] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:28 2022] DELETE /identity/v3/projects/72f4e78cd69041eaa1f81b3ea4ed27d4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:28.680938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdbb9a-12a8-4d6c-b8f1-1926f2c8213e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:28.681470 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdbb9a-12a8-4d6c-b8f1-1926f2c8213e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:28.681577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdbb9a-12a8-4d6c-b8f1-1926f2c8213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:28.700316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-28bdbb9a-12a8-4d6c-b8f1-1926f2c8213e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:28.701530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-28bdbb9a-12a8-4d6c-b8f1-1926f2c8213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:28.763010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1218/2474] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:28.771954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9234cc-a3ef-484c-94ea-80664af71695 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:28.772240 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9234cc-a3ef-484c-94ea-80664af71695 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:28.772517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9234cc-a3ef-484c-94ea-80664af71695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:28.791136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6d9234cc-a3ef-484c-94ea-80664af71695 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:28.792366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6d9234cc-a3ef-484c-94ea-80664af71695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:28.800524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1257/2475] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:28.805021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdbb9a-12a8-4d6c-b8f1-1926f2c8213e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:28.814741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdbb9a-12a8-4d6c-b8f1-1926f2c8213e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:28.819526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:28.820216 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:28.820508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:28.820783 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:28.821530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:37:28.821843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:28.823495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:28.836670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1219/2476] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:37:28.841707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9234cc-a3ef-484c-94ea-80664af71695 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:28.851588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9234cc-a3ef-484c-94ea-80664af71695 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:28.856361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:28.857035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:28.857305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:28.857579 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:28.858320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:28.860388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:28.995275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1258/2477] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:28 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:28.999488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.009451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b165-7b85-46a2-a6ec-4e59d2eb9f77 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.063604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.064271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.064558 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.064891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.065524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.067433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:29.170851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1220/2478] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:28 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:29.175184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.186199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bff5f-4966-442d-92b3-6e3e2d68783e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.192585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.192585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.192585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.193031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.193505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.195115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:29.208084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1259/2479] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:29.213243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.224202 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeab67-04d0-4110-a746-40783c20111e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.228839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872285c-fa39-4d5d-ad53-ca5a66601d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.229497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872285c-fa39-4d5d-ad53-ca5a66601d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.229778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872285c-fa39-4d5d-ad53-ca5a66601d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.230052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872285c-fa39-4d5d-ad53-ca5a66601d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.230766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872285c-fa39-4d5d-ad53-ca5a66601d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.232434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872285c-fa39-4d5d-ad53-ca5a66601d59 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:29.242502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1221/2480] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:29.246637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.257304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec943fb-cf5f-40fb-9183-8a180eb5dba0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.262319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.263199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.263507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.263785 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] PATH_INFO: `/v3/projects/2a2b929d2c0d4f00ba1610b34dc82ea3/users/9922c3282dc349d286cc93d782c243e5/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.279996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2b929d2c0d4f00ba1610b34dc82ea3, user_id=9922c3282dc349d286cc93d782c243e5, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.282664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:29.394131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1260/2481] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:29 2022] PUT /identity/v3/projects/2a2b929d2c0d4f00ba1610b34dc82ea3/users/9922c3282dc349d286cc93d782c243e5/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:37:29.404905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dbd18-9d00-4583-a6c6-42758c73e1a9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.405186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dbd18-9d00-4583-a6c6-42758c73e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.405474 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dbd18-9d00-4583-a6c6-42758c73e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.432462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b24dbd18-9d00-4583-a6c6-42758c73e1a9 None None] MFA Rules not processed for user `9922c3282dc349d286cc93d782c243e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:29.433671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b24dbd18-9d00-4583-a6c6-42758c73e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:29.499326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1222/2482] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:29.504075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.567619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c83904-8fe2-45ef-b6b1-0622f8d8a993 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.572455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.573131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.573415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.573695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.574524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.576397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:29.676314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1261/2483] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:29 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:29.679653 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dbd18-9d00-4583-a6c6-42758c73e1a9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.691337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dbd18-9d00-4583-a6c6-42758c73e1a9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.748742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.749421 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.749712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.750539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.751315 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.753372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:29.866192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1223/2484] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:29 2022] POST /identity/v3/users => generated 309 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:29.870553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.881072 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c049f-7c21-44a3-ad9c-442c19babf37 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.885555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.886204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.886580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.886861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.887625 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.889223 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:29.899754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1262/2485] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:29.904153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:29.915411 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ef6a-b5a3-4760-96c6-3ab57e08f548 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:29.921036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:29.922612 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:29.922908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:29.923186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] PATH_INFO: `/v3/projects/a435873c42bc4849a8c2f62134f73a95/users/efd4677cfc224d7bbd023843563e784b/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:29.939139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a435873c42bc4849a8c2f62134f73a95, user_id=efd4677cfc224d7bbd023843563e784b, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:29.941804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:30.039760 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1224/2486] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:29 2022] PUT /identity/v3/projects/a435873c42bc4849a8c2f62134f73a95/users/efd4677cfc224d7bbd023843563e784b/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:30.043913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:30.054522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572ee8-2749-487a-bc81-01a2ca77b2ae admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:30.109149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7abd69-ef71-4584-810d-47a5604dc895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:30.110411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7abd69-ef71-4584-810d-47a5604dc895 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:30.110690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7abd69-ef71-4584-810d-47a5604dc895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:30.110984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7abd69-ef71-4584-810d-47a5604dc895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:30.111738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7abd69-ef71-4584-810d-47a5604dc895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:30.113351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7abd69-ef71-4584-810d-47a5604dc895 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:30.123114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1263/2487] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:30.127422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:30.137610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c519-86f8-487d-a255-8e5f810f08f7 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:30.142296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:30.143171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:30.143454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:30.143768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] PATH_INFO: `/v3/projects/a435873c42bc4849a8c2f62134f73a95/users/efd4677cfc224d7bbd023843563e784b/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:30.145711 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a435873c42bc4849a8c2f62134f73a95, user_id=efd4677cfc224d7bbd023843563e784b, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:30.148390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:30.158968 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1225/2488] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:30 2022] PUT /identity/v3/projects/a435873c42bc4849a8c2f62134f73a95/users/efd4677cfc224d7bbd023843563e784b/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:30.169034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739799-aafe-416c-bc6a-0a7e73bc1ec6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:30.169324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739799-aafe-416c-bc6a-0a7e73bc1ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:30.169603 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739799-aafe-416c-bc6a-0a7e73bc1ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:30.196271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-36739799-aafe-416c-bc6a-0a7e73bc1ec6 None None] MFA Rules not processed for user `efd4677cfc224d7bbd023843563e784b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:30.197390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-36739799-aafe-416c-bc6a-0a7e73bc1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:30.263272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1264/2489] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:30.274866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:30.276677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:30.334919 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbccbe-205d-43a3-a44d-5c787d8e3fd3 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:30.338851 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400d910-f273-4ac7-b12e-2c58584c388c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:30.339537 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400d910-f273-4ac7-b12e-2c58584c388c service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:30.339825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400d910-f273-4ac7-b12e-2c58584c388c service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:30.340103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400d910-f273-4ac7-b12e-2c58584c388c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:30.350218 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400d910-f273-4ac7-b12e-2c58584c388c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:30.351679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400d910-f273-4ac7-b12e-2c58584c388c service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:30.361410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1226/2490] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:30 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:30.678102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739799-aafe-416c-bc6a-0a7e73bc1ec6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:30.746773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739799-aafe-416c-bc6a-0a7e73bc1ec6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:30.752021 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:30.752932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:30.754465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:30.754465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] PATH_INFO: `/v3/users/9922c3282dc349d286cc93d782c243e5` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:30.754696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9922c3282dc349d286cc93d782c243e5)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:30.756846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:31.161070 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9922c3282dc349d286cc93d782c243e5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:31.161834 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9922c3282dc349d286cc93d782c243e5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:31.296594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9922c3282dc349d286cc93d782c243e5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:31.304933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9922c3282dc349d286cc93d782c243e5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:31.307892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9922c3282dc349d286cc93d782c243e5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:31.322996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1265/2491] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:30 2022] DELETE /identity/v3/users/9922c3282dc349d286cc93d782c243e5 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:31.327611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:31.328124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:31.328230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:31.346304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:31.347580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:31.410160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1227/2492] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:31.420126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:31.421560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:31.480088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe71c-b5ad-4fbc-abb9-97c3f41f0351 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:31.483767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:31.485135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:31.485415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:31.485691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:31.495097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:31.496547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:31.505984 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1266/2493] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:31.678945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:31.680366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:31.754476 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac615d-43cf-46d8-b3f9-0687fb4ca1a2 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:31.759309 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:31.760052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:31.760384 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:31.760596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:31.763186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:31.839453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:31.840937 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:31.851568 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1228/2494] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:31.963975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:31.965361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:31.979637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e287-2d28-4d04-94fb-1e9284aa9185 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:31.984589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:31.985450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:31.985727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:31.985999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] PATH_INFO: `/v3/projects/2a2b929d2c0d4f00ba1610b34dc82ea3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:31.987366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2b929d2c0d4f00ba1610b34dc82ea3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:31.999779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:32.117608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2b929d2c0d4f00ba1610b34dc82ea3', 'request_id': 'req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.125510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2b929d2c0d4f00ba1610b34dc82ea3', 'request_id': 'req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.213524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2b929d2c0d4f00ba1610b34dc82ea3', 'request_id': 'req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.226390 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] The token cache is being invalidate because project 2a2b929d2c0d4f00ba1610b34dc82ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:32.226677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.227331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.229005 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1267/2495] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:31 2022] DELETE /identity/v3/projects/2a2b929d2c0d4f00ba1610b34dc82ea3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:32.233268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:32.243801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cf4d6-c01b-448e-a2da-4858bb86f460 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:32.301339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:32.302251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:32.302539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:32.302916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] PATH_INFO: `/v3/users/efd4677cfc224d7bbd023843563e784b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:32.304137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd4677cfc224d7bbd023843563e784b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:32.306064 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:32.541012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd4677cfc224d7bbd023843563e784b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.548748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd4677cfc224d7bbd023843563e784b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.644725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd4677cfc224d7bbd023843563e784b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.657068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd4677cfc224d7bbd023843563e784b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.657751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e009c329-3073-41af-9688-a52fd6908f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd4677cfc224d7bbd023843563e784b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:32.663604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1229/2496] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:32 2022] DELETE /identity/v3/users/efd4677cfc224d7bbd023843563e784b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:33.116215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:33.117933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:33.133912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be74e-12ab-47d8-940e-1e9b0ecfcd5f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:33.191542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:33.192409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:33.192691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:33.192965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] PATH_INFO: `/v3/projects/a435873c42bc4849a8c2f62134f73a95` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:33.194147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a435873c42bc4849a8c2f62134f73a95)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:33.196114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:33.310052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a435873c42bc4849a8c2f62134f73a95', 'request_id': 'req-006f65b1-4280-4876-a17f-e05efdb3fa18'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:33.316262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a435873c42bc4849a8c2f62134f73a95', 'request_id': 'req-006f65b1-4280-4876-a17f-e05efdb3fa18'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:33.378962 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a435873c42bc4849a8c2f62134f73a95', 'request_id': 'req-006f65b1-4280-4876-a17f-e05efdb3fa18'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:33.390948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] The token cache is being invalidate because project a435873c42bc4849a8c2f62134f73a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:33.391274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:33.391981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-006f65b1-4280-4876-a17f-e05efdb3fa18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:33.393667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1268/2497] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:33 2022] DELETE /identity/v3/projects/a435873c42bc4849a8c2f62134f73a95 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:33.399051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb8ec-f621-4a10-ad4d-5da7ad5d05cd None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:33.399348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb8ec-f621-4a10-ad4d-5da7ad5d05cd None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:33.399660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb8ec-f621-4a10-ad4d-5da7ad5d05cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:33.420408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-288bb8ec-f621-4a10-ad4d-5da7ad5d05cd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:33.421534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-288bb8ec-f621-4a10-ad4d-5da7ad5d05cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:33.491582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1230/2498] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:33.500469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404c733-a12d-4775-85a7-e7d2a2bc4ec6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:33.503721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404c733-a12d-4775-85a7-e7d2a2bc4ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:33.503721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404c733-a12d-4775-85a7-e7d2a2bc4ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:33.521681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5404c733-a12d-4775-85a7-e7d2a2bc4ec6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:33.522912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5404c733-a12d-4775-85a7-e7d2a2bc4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:33.532645 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1269/2499] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:33.537632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb8ec-f621-4a10-ad4d-5da7ad5d05cd None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:33.551155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb8ec-f621-4a10-ad4d-5da7ad5d05cd None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:33.556036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:33.556722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:33.557004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:33.557280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:33.558003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:37:33.558313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:33.559934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:33.572324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1231/2500] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:37:33.576898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404c733-a12d-4775-85a7-e7d2a2bc4ec6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:33.586164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404c733-a12d-4775-85a7-e7d2a2bc4ec6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:33.591237 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:33.591913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:33.592204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:33.592483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:33.593165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:33.595595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:33.752130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1270/2501] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:33 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:33.756328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:33.766540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ef76-85d4-4374-8438-98d597d3fda8 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:33.827091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:33.827810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:33.828160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:33.828444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:33.829148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:33.831737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:33.953938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1232/2502] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:33 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:37:33.958127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:33.969228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67000-955f-44c3-bb9f-8b465b65aea4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:33.973815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:33.974467 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:33.974747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:33.975018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:33.975763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:33.977349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:33.988922 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1271/2503] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:33.992976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.004381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584796e-0ffe-4db8-a187-4650d93e1693 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.008950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8b1b8-3fc5-46b0-a94a-1c669f4b838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.009609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8b1b8-3fc5-46b0-a94a-1c669f4b838d admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.009892 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8b1b8-3fc5-46b0-a94a-1c669f4b838d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.010173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8b1b8-3fc5-46b0-a94a-1c669f4b838d admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.010895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8b1b8-3fc5-46b0-a94a-1c669f4b838d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.012514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8b1b8-3fc5-46b0-a94a-1c669f4b838d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.023762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1233/2504] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:34.027931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.039123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfb27-6f17-4849-bcf9-1e9a5baaefcd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.043709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.044588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.044894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.045165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] PATH_INFO: `/v3/projects/9283f03f78354994b56e69c11a9c1cfc/users/74fb841d4dc64bbcbcfe500f0d01148c/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.059398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9283f03f78354994b56e69c11a9c1cfc, user_id=74fb841d4dc64bbcbcfe500f0d01148c, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.062083 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.148138 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1272/2505] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:34 2022] PUT /identity/v3/projects/9283f03f78354994b56e69c11a9c1cfc/users/74fb841d4dc64bbcbcfe500f0d01148c/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:37:34.160390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3a39-55de-4453-9b5e-8f016c5c630c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.167399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3a39-55de-4453-9b5e-8f016c5c630c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.167399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3a39-55de-4453-9b5e-8f016c5c630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.196192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-644a3a39-55de-4453-9b5e-8f016c5c630c None None] MFA Rules not processed for user `74fb841d4dc64bbcbcfe500f0d01148c`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:34.197451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-644a3a39-55de-4453-9b5e-8f016c5c630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:34.261208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1234/2506] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:34.266135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.325810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902c1f-bb0b-46e4-9f78-338119b44796 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.331349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.332075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.332371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.332646 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.333355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.335336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.441060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1273/2507] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:34 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:34.445021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a3a39-55de-4453-9b5e-8f016c5c630c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.456366 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a3a39-55de-4453-9b5e-8f016c5c630c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.512588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.513176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.513479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.513745 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.514494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.516979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.645372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1235/2508] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:34 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:34.649400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.659528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2c54-c42d-40b8-9c0b-bb061002cdb8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.664022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.664673 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.664950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.665222 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.665940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.667586 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.680234 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1274/2509] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:34.683342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.695023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3cc42-1382-46dd-a2bf-de59fa975109 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.699719 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.700607 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.700893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.701166 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] PATH_INFO: `/v3/projects/efc311b2a2ba4fe39e3250a20d23b7c6/users/ee2e753bd7d34d989a4d59a8fcfa0080/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.720371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc311b2a2ba4fe39e3250a20d23b7c6, user_id=ee2e753bd7d34d989a4d59a8fcfa0080, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.723397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.811032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1236/2510] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:34 2022] PUT /identity/v3/projects/efc311b2a2ba4fe39e3250a20d23b7c6/users/ee2e753bd7d34d989a4d59a8fcfa0080/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:37:34.815742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.825832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076370-3e94-405c-b900-0c3a41b886af admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.887116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df26c-9a37-4e54-a09b-3629713cee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.887819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df26c-9a37-4e54-a09b-3629713cee65 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.888098 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df26c-9a37-4e54-a09b-3629713cee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.888371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df26c-9a37-4e54-a09b-3629713cee65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.889085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df26c-9a37-4e54-a09b-3629713cee65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.891015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df26c-9a37-4e54-a09b-3629713cee65 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.900828 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1275/2511] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:34.904882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:34.915339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6610a8-0a67-4794-a852-4bc5bf12486c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:34.919984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:34.920884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.921164 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.921450 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] PATH_INFO: `/v3/projects/efc311b2a2ba4fe39e3250a20d23b7c6/users/ee2e753bd7d34d989a4d59a8fcfa0080/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.923975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc311b2a2ba4fe39e3250a20d23b7c6, user_id=ee2e753bd7d34d989a4d59a8fcfa0080, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:34.926628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:34.937071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1237/2512] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:34 2022] PUT /identity/v3/projects/efc311b2a2ba4fe39e3250a20d23b7c6/users/ee2e753bd7d34d989a4d59a8fcfa0080/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:34.947725 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:34.948048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:34.948296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:34.976398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] MFA Rules not processed for user `ee2e753bd7d34d989a4d59a8fcfa0080`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:34.977664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:35.045886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1276/2513] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:35.057486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:35.059182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:35.118531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6e94-9024-4940-bb81-d7f5e7d68667 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:35.122236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:35.122883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:35.123160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:35.123434 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:35.132604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:35.134040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:35.143386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1238/2514] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:35.290073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:35.291917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:35.304964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab34d9d-00d7-4ce0-aaa3-6b8c2eb1855d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:35.309216 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cb394-cfb0-4d83-b9bb-e2e83e0f03a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:35.310176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cb394-cfb0-4d83-b9bb-e2e83e0f03a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:35.310615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cb394-cfb0-4d83-b9bb-e2e83e0f03a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:35.311038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cb394-cfb0-4d83-b9bb-e2e83e0f03a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:35.368310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cb394-cfb0-4d83-b9bb-e2e83e0f03a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:35.369654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cb394-cfb0-4d83-b9bb-e2e83e0f03a5 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:35.378569 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1277/2515] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:40.533219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:40.597475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b080b-4bbb-4f17-b968-21c5271e0a41 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:40.602751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:40.603663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:40.603943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:40.604215 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] PATH_INFO: `/v3/users/74fb841d4dc64bbcbcfe500f0d01148c` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:40.605429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74fb841d4dc64bbcbcfe500f0d01148c)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:40.607499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:40.822834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74fb841d4dc64bbcbcfe500f0d01148c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:40.830636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74fb841d4dc64bbcbcfe500f0d01148c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:40.903949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74fb841d4dc64bbcbcfe500f0d01148c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:40.917333 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74fb841d4dc64bbcbcfe500f0d01148c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:40.918121 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74fb841d4dc64bbcbcfe500f0d01148c'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:40.925195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1239/2516] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:40 2022] DELETE /identity/v3/users/74fb841d4dc64bbcbcfe500f0d01148c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:40.929734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:40.930484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:40.930484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:40.948854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:40.950057 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:41.010465 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1278/2517] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:41.020415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:41.021848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:41.081480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be211c8-47a2-4380-a955-6b7ddeea1586 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:41.085256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:41.085908 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:41.086197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:41.086480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:41.096938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:41.098387 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:41.109672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1240/2518] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:41.540630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:41.546543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:41.555978 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30635a02-2441-42bd-9f59-31f59b7b4944 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:41.560642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:41.561648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:41.561941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:41.562213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] PATH_INFO: `/v3/projects/9283f03f78354994b56e69c11a9c1cfc` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:41.563683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9283f03f78354994b56e69c11a9c1cfc)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:41.565593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:41.799218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9283f03f78354994b56e69c11a9c1cfc', 'request_id': 'req-2d43bf13-df3b-475a-8bbc-7d8e54204647'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:41.807363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9283f03f78354994b56e69c11a9c1cfc', 'request_id': 'req-2d43bf13-df3b-475a-8bbc-7d8e54204647'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:41.909843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9283f03f78354994b56e69c11a9c1cfc', 'request_id': 'req-2d43bf13-df3b-475a-8bbc-7d8e54204647'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:41.921565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] The token cache is being invalidate because project 9283f03f78354994b56e69c11a9c1cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:41.922100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:41.924930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:41.926581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1279/2519] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:41 2022] DELETE /identity/v3/projects/9283f03f78354994b56e69c11a9c1cfc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:41.930877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:41.941230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f035c6-a3cd-442e-9249-bc2102e5feca service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:42.004012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:42.004897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:42.005245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:42.005525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] PATH_INFO: `/v3/users/ee2e753bd7d34d989a4d59a8fcfa0080` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:42.006818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2e753bd7d34d989a4d59a8fcfa0080)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:42.008729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:42.250674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2e753bd7d34d989a4d59a8fcfa0080'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:42.258042 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2e753bd7d34d989a4d59a8fcfa0080'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:42.339068 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2e753bd7d34d989a4d59a8fcfa0080'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:42.361505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2e753bd7d34d989a4d59a8fcfa0080'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:42.362680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-31d5d94e-4a12-4af5-a232-7ae3ea32ba24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2e753bd7d34d989a4d59a8fcfa0080'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:42.373960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1241/2520] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:41 2022] DELETE /identity/v3/users/ee2e753bd7d34d989a4d59a8fcfa0080 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:42.832037 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:42.834380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:42.857382 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bf13-df3b-475a-8bbc-7d8e54204647 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:42.930707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:42.931761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:42.932019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:42.932301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] PATH_INFO: `/v3/projects/efc311b2a2ba4fe39e3250a20d23b7c6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:42.933788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc311b2a2ba4fe39e3250a20d23b7c6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:42.935876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:43.078385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc311b2a2ba4fe39e3250a20d23b7c6', 'request_id': 'req-89c01b46-c21b-4e5e-a941-8eeaea57c79c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:43.086406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc311b2a2ba4fe39e3250a20d23b7c6', 'request_id': 'req-89c01b46-c21b-4e5e-a941-8eeaea57c79c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:43.164675 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc311b2a2ba4fe39e3250a20d23b7c6', 'request_id': 'req-89c01b46-c21b-4e5e-a941-8eeaea57c79c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:43.176434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] The token cache is being invalidate because project efc311b2a2ba4fe39e3250a20d23b7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:43.176721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:43.179862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-89c01b46-c21b-4e5e-a941-8eeaea57c79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:43.179862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1280/2521] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:42 2022] DELETE /identity/v3/projects/efc311b2a2ba4fe39e3250a20d23b7c6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:43.184482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86edef2-052f-42dc-bad9-bb7aefce3a96 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.185299 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86edef2-052f-42dc-bad9-bb7aefce3a96 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.185472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86edef2-052f-42dc-bad9-bb7aefce3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.205843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-b86edef2-052f-42dc-bad9-bb7aefce3a96 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:43.207631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b86edef2-052f-42dc-bad9-bb7aefce3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:43.286593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1242/2522] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:43.295803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6982d6-db33-4bd4-a5fa-cb7d2a488c61 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.296090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6982d6-db33-4bd4-a5fa-cb7d2a488c61 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.296412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6982d6-db33-4bd4-a5fa-cb7d2a488c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.314924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2a6982d6-db33-4bd4-a5fa-cb7d2a488c61 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:43.316176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2a6982d6-db33-4bd4-a5fa-cb7d2a488c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:43.328297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1281/2523] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:43.337658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86edef2-052f-42dc-bad9-bb7aefce3a96 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:43.344123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86edef2-052f-42dc-bad9-bb7aefce3a96 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:43.352757 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:43.353581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.353906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.354342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.355192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:37:43.355635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:43.357477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:43.370370 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1243/2524] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:37:43.375564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6982d6-db33-4bd4-a5fa-cb7d2a488c61 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:43.385106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6982d6-db33-4bd4-a5fa-cb7d2a488c61 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:43.390090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:43.391308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.391645 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.391957 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.392664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:43.394601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:43.538525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1282/2525] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:43 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:43.542941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:43.554684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f88bc-c8d2-46b1-a01d-cd18db812cc8 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:43.616295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:43.616931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.617213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.617489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.618226 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:43.620192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:43.705375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1244/2526] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:43 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:37:43.710116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:43.722302 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a7b0-5f9c-43c6-beda-5509370d712b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:43.727991 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:43.728754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.731570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.731570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.731570 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:43.732520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:43.745758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1283/2527] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:43.750877 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:43.769149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3be1-278f-4b0d-9da2-b5da513ad29a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:43.777168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a359bd-62f3-44d9-8e34-462d99014c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:43.778344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a359bd-62f3-44d9-8e34-462d99014c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.778847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a359bd-62f3-44d9-8e34-462d99014c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.779348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a359bd-62f3-44d9-8e34-462d99014c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.781350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a359bd-62f3-44d9-8e34-462d99014c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:43.784710 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a359bd-62f3-44d9-8e34-462d99014c6e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:43.797157 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1245/2528] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:37:43.801889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:43.813761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57d501-91a3-4fc8-b2d6-1620f4d30100 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:43.823055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:43.823055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.823550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.824081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] PATH_INFO: `/v3/projects/2d6e3dfa29bf45e8aefd7fa1ffbc5ab1/users/3605a1c23ab74f2791339c221256f8eb/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.842596 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6e3dfa29bf45e8aefd7fa1ffbc5ab1, user_id=3605a1c23ab74f2791339c221256f8eb, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:43.845953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:43.922599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1284/2529] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:43 2022] PUT /identity/v3/projects/2d6e3dfa29bf45e8aefd7fa1ffbc5ab1/users/3605a1c23ab74f2791339c221256f8eb/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:43.934492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4ff6-b0a6-42ab-9968-3db164672f24 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:43.934831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4ff6-b0a6-42ab-9968-3db164672f24 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:43.935146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4ff6-b0a6-42ab-9968-3db164672f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:43.965959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-25cb4ff6-b0a6-42ab-9968-3db164672f24 None None] MFA Rules not processed for user `3605a1c23ab74f2791339c221256f8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:43.967286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-25cb4ff6-b0a6-42ab-9968-3db164672f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:44.039270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1246/2530] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:44.043855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:44.109965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d24c-3429-4392-bbf9-badb60d50b58 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:44.115023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:44.115703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:44.116046 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:44.116323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:44.117032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:44.119025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:44.221398 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1285/2531] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:44 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:44.227785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4ff6-b0a6-42ab-9968-3db164672f24 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:44.244010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4ff6-b0a6-42ab-9968-3db164672f24 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:44.333680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:44.334588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:44.335034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:44.335446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:44.336367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:44.338818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:44.474673 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1247/2532] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:44 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:44.479528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:44.497826 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5921b35-51b9-4dfb-bf16-88b64304739c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:44.505378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:44.506739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:44.507164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:44.519154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:44.519154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:44.519154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:44.525975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1286/2533] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:44.530541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:44.541317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ed675-bcc2-4793-a095-0ca2d4340e62 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:44.549080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:44.549991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:44.550270 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:44.550541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] PATH_INFO: `/v3/projects/9cabd8cbf4e4415d9ae1e06f00b1f669/users/c42b5aa65ae54b33a2535d6ebdb8115a/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:44.569217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cabd8cbf4e4415d9ae1e06f00b1f669, user_id=c42b5aa65ae54b33a2535d6ebdb8115a, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:44.571958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:44.665206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1248/2534] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:44 2022] PUT /identity/v3/projects/9cabd8cbf4e4415d9ae1e06f00b1f669/users/c42b5aa65ae54b33a2535d6ebdb8115a/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:44.669380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:44.680882 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927e17f-089f-42d5-a7d4-93ec8f9f5f03 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:44.744952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e250d8-c733-479e-81eb-48031d048e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:44.745528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e250d8-c733-479e-81eb-48031d048e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:44.745809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e250d8-c733-479e-81eb-48031d048e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:44.746082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e250d8-c733-479e-81eb-48031d048e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:44.746812 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e250d8-c733-479e-81eb-48031d048e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:44.748578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e250d8-c733-479e-81eb-48031d048e8c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:44.761610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1287/2535] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:44.767124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:44.784983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83889336-1fd6-402c-94d4-03b4005af61d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:44.798667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:44.799679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:44.799961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:44.800239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] PATH_INFO: `/v3/projects/9cabd8cbf4e4415d9ae1e06f00b1f669/users/c42b5aa65ae54b33a2535d6ebdb8115a/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:44.802343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cabd8cbf4e4415d9ae1e06f00b1f669, user_id=c42b5aa65ae54b33a2535d6ebdb8115a, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:44.805153 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:44.817953 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1249/2536] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:44 2022] PUT /identity/v3/projects/9cabd8cbf4e4415d9ae1e06f00b1f669/users/c42b5aa65ae54b33a2535d6ebdb8115a/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:44.829284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21f43-453f-48a6-bb95-b72f1b115d7d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:44.829833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21f43-453f-48a6-bb95-b72f1b115d7d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:44.830160 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21f43-453f-48a6-bb95-b72f1b115d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:44.880139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-43f21f43-453f-48a6-bb95-b72f1b115d7d None None] MFA Rules not processed for user `c42b5aa65ae54b33a2535d6ebdb8115a`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:44.886477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-43f21f43-453f-48a6-bb95-b72f1b115d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:44.964671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1288/2537] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:44.983293 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:44.986726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:45.058654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892643c-9ef7-4aab-b3bc-bf31a655b2d9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:45.064351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a6396-6e63-4736-a1b0-6f0120d8dc86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:45.065159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a6396-6e63-4736-a1b0-6f0120d8dc86 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:45.065486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a6396-6e63-4736-a1b0-6f0120d8dc86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:45.065808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a6396-6e63-4736-a1b0-6f0120d8dc86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:45.076870 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a6396-6e63-4736-a1b0-6f0120d8dc86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:45.078467 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a6396-6e63-4736-a1b0-6f0120d8dc86 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:45.091552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1250/2538] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:45.175184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21f43-453f-48a6-bb95-b72f1b115d7d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:45.252889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21f43-453f-48a6-bb95-b72f1b115d7d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:45.259861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:45.261415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:45.261943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:45.262427 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] PATH_INFO: `/v3/users/3605a1c23ab74f2791339c221256f8eb` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:45.264261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3605a1c23ab74f2791339c221256f8eb)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:45.268135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:45.506628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3605a1c23ab74f2791339c221256f8eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:45.507329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3605a1c23ab74f2791339c221256f8eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:45.581660 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3605a1c23ab74f2791339c221256f8eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:45.590239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3605a1c23ab74f2791339c221256f8eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:45.591013 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3605a1c23ab74f2791339c221256f8eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:45.610460 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1289/2539] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:45 2022] DELETE /identity/v3/users/3605a1c23ab74f2791339c221256f8eb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:45.615557 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:45.616140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:45.616140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:45.642133 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:45.644339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:45.712592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1251/2540] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:37:45.724263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:45.726455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:45.797043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a97c-e8df-4acc-936d-07150fb1130e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:45.801449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:45.802106 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:45.802391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:45.802671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:45.812871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:45.814358 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:45.825405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1290/2541] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:46.355192 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:46.357014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:46.371761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8f91f-aa9e-4b3e-b5da-ca47926f4956 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:46.377789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:46.378694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:46.378987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:46.379268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] PATH_INFO: `/v3/projects/2d6e3dfa29bf45e8aefd7fa1ffbc5ab1` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:46.380626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6e3dfa29bf45e8aefd7fa1ffbc5ab1)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:46.382618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:46.547219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6e3dfa29bf45e8aefd7fa1ffbc5ab1', 'request_id': 'req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:46.554163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6e3dfa29bf45e8aefd7fa1ffbc5ab1', 'request_id': 'req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:46.622185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6e3dfa29bf45e8aefd7fa1ffbc5ab1', 'request_id': 'req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:46.635501 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] The token cache is being invalidate because project 2d6e3dfa29bf45e8aefd7fa1ffbc5ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:46.640823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:46.640823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:46.640823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1252/2542] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:46 2022] DELETE /identity/v3/projects/2d6e3dfa29bf45e8aefd7fa1ffbc5ab1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:46.643067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:46.654414 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa78321-b29b-4378-a405-49cac943e29a service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:46.719134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:46.720115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:46.720430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:46.720677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] PATH_INFO: `/v3/users/c42b5aa65ae54b33a2535d6ebdb8115a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:46.722038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42b5aa65ae54b33a2535d6ebdb8115a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:46.724084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:46.969038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42b5aa65ae54b33a2535d6ebdb8115a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:46.969887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42b5aa65ae54b33a2535d6ebdb8115a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.110727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42b5aa65ae54b33a2535d6ebdb8115a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.118668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42b5aa65ae54b33a2535d6ebdb8115a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.119403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b50f7f33-2654-4aa2-bd28-147418b5f39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42b5aa65ae54b33a2535d6ebdb8115a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.145134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1291/2543] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:37:46 2022] DELETE /identity/v3/users/c42b5aa65ae54b33a2535d6ebdb8115a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:37:47.631943 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:47.634336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:47.655025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceccfbf-c1cf-47eb-a135-d3586c6a1f24 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:47.756930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:47.758424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:47.758942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:47.759447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] PATH_INFO: `/v3/projects/9cabd8cbf4e4415d9ae1e06f00b1f669` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:47.761351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cabd8cbf4e4415d9ae1e06f00b1f669)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:47.763582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:47.883414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cabd8cbf4e4415d9ae1e06f00b1f669', 'request_id': 'req-f42a2c69-1df2-4455-af55-0898cabed213'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.891040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cabd8cbf4e4415d9ae1e06f00b1f669', 'request_id': 'req-f42a2c69-1df2-4455-af55-0898cabed213'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.961328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cabd8cbf4e4415d9ae1e06f00b1f669', 'request_id': 'req-f42a2c69-1df2-4455-af55-0898cabed213'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.974255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] The token cache is being invalidate because project 9cabd8cbf4e4415d9ae1e06f00b1f669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:37:47.974556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.975405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f42a2c69-1df2-4455-af55-0898cabed213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:37:47.985736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1253/2544] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:37:47 2022] DELETE /identity/v3/projects/9cabd8cbf4e4415d9ae1e06f00b1f669 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:47.995905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63728bb-08b5-4e45-89b3-afbdc0a46f3f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:47.996463 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63728bb-08b5-4e45-89b3-afbdc0a46f3f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:47.996612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63728bb-08b5-4e45-89b3-afbdc0a46f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.016497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b63728bb-08b5-4e45-89b3-afbdc0a46f3f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:48.017817 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b63728bb-08b5-4e45-89b3-afbdc0a46f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:48.086139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1292/2545] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:37:48.096072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd339e-2b74-454e-b294-6152aba29e17 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.096408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd339e-2b74-454e-b294-6152aba29e17 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.096755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd339e-2b74-454e-b294-6152aba29e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.116095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-78bd339e-2b74-454e-b294-6152aba29e17 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:48.117467 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-78bd339e-2b74-454e-b294-6152aba29e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:48.126681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1254/2546] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:48.131406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63728bb-08b5-4e45-89b3-afbdc0a46f3f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:48.143084 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63728bb-08b5-4e45-89b3-afbdc0a46f3f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:48.148392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:48.149079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.149375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.149659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.150417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:37:48.150727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:48.152590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:48.180208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1293/2547] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:37:48.190397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd339e-2b74-454e-b294-6152aba29e17 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:48.203961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd339e-2b74-454e-b294-6152aba29e17 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:48.209459 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:48.210141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.210431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.210709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.212033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:48.214038 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:48.397289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1255/2548] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:48 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:48.402290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:48.420360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f93a2-b0b3-41ce-99e9-dcde108197b9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:48.485753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:48.486788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.487309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.487719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.488626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:48.490942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:48.613385 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1294/2549] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:48 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:48.618089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:48.630629 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0fea4-98a0-491f-b299-18922296316f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:48.636556 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:48.637285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.637550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.637860 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.638602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:48.641127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:48.675874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1256/2550] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:48.679225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:48.690034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20b82-b210-44c9-9946-bec9e2cf6073 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:48.694752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6618e-c238-41a0-9b10-2882b541d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:48.695412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6618e-c238-41a0-9b10-2882b541d35d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.695726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6618e-c238-41a0-9b10-2882b541d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.696004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6618e-c238-41a0-9b10-2882b541d35d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.696722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6618e-c238-41a0-9b10-2882b541d35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:48.698320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6618e-c238-41a0-9b10-2882b541d35d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:48.709486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1295/2551] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:48.724514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:48.735329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef9832-7d5f-4abd-afb6-cfb6d2e2d498 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:48.739916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:48.740830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.741130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.741414 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] PATH_INFO: `/v3/projects/cee8598014074a65a8342ce3b5af7a14/users/b7fb1546d36f4c909693dd786a7536a5/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.760225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee8598014074a65a8342ce3b5af7a14, user_id=b7fb1546d36f4c909693dd786a7536a5, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:48.763297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:48.886080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1257/2552] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:48 2022] PUT /identity/v3/projects/cee8598014074a65a8342ce3b5af7a14/users/b7fb1546d36f4c909693dd786a7536a5/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:48.898364 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bc880-02f9-40bd-9e1c-6380b8606339 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:48.899081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bc880-02f9-40bd-9e1c-6380b8606339 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:48.899585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bc880-02f9-40bd-9e1c-6380b8606339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:48.946163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-658bc880-02f9-40bd-9e1c-6380b8606339 None None] MFA Rules not processed for user `b7fb1546d36f4c909693dd786a7536a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:48.947499 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-658bc880-02f9-40bd-9e1c-6380b8606339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:49.035406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1296/2553] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:49.042014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.120407 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a8aa-2b63-491a-9912-1ceba6a8a99a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:49.126423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:49.127308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.127724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.128189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.129003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:49.131210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:49.260490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1258/2554] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:37:49 2022] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:49.265201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bc880-02f9-40bd-9e1c-6380b8606339 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.278618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bc880-02f9-40bd-9e1c-6380b8606339 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:49.345618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:49.346309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.346592 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.346845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.347591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:49.349799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:49.456983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1297/2555] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:37:49 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:37:49.461526 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.473730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17122-92a3-4483-9f1b-9ebc30c7ac6a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:49.478848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:49.479648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.479940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.480274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.481015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:49.482793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:49.495126 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1259/2556] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:49.500213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.511000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993ef21-348c-4d84-91a2-bdf686b56d6c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:49.516213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:49.517111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.517393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.517669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] PATH_INFO: `/v3/projects/65525c0365b5400ca5a1d55e55e90060/users/73235282fea5488dbc6b080126a46d4b/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.535368 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=65525c0365b5400ca5a1d55e55e90060, user_id=73235282fea5488dbc6b080126a46d4b, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:49.538309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:49.677134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1298/2557] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:49 2022] PUT /identity/v3/projects/65525c0365b5400ca5a1d55e55e90060/users/73235282fea5488dbc6b080126a46d4b/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:37:49.682025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.692849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abf9c0-70e0-478a-babb-6e2e9f0ee7eb admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:49.779733 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1ac4e-fe02-4c0f-943e-9506d3a7f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:49.780456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1ac4e-fe02-4c0f-943e-9506d3a7f0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.782656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1ac4e-fe02-4c0f-943e-9506d3a7f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.782656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1ac4e-fe02-4c0f-943e-9506d3a7f0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.782656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1ac4e-fe02-4c0f-943e-9506d3a7f0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:49.783976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1ac4e-fe02-4c0f-943e-9506d3a7f0b6 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:49.794954 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1260/2558] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:37:49.799327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.816384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8e78-7589-4b19-8a51-2ee3fdc52fcf admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:49.824617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:49.825583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.825895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.826174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] PATH_INFO: `/v3/projects/65525c0365b5400ca5a1d55e55e90060/users/73235282fea5488dbc6b080126a46d4b/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.828852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65525c0365b5400ca5a1d55e55e90060, user_id=73235282fea5488dbc6b080126a46d4b, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:49.831786 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:49.845244 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1299/2559] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:37:49 2022] PUT /identity/v3/projects/65525c0365b5400ca5a1d55e55e90060/users/73235282fea5488dbc6b080126a46d4b/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:37:49.856977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.857382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.857759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.887179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] MFA Rules not processed for user `73235282fea5488dbc6b080126a46d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:49.888533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:49.975359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1261/2560] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:49.990871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.992853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:50.062559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0de5fd-b488-4450-93a7-594017483b58 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:50.066538 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:50.067208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:50.067510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:50.067795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:50.078549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:50.080253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:50.091855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1300/2561] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:37:50.403428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:50.405426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:50.424625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865babb0-6d2c-4bfb-ba55-3cb2816201b7 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:50.429731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8414-8163-4a41-87e3-728f41581179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:50.430528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8414-8163-4a41-87e3-728f41581179 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:50.430850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8414-8163-4a41-87e3-728f41581179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:50.431165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8414-8163-4a41-87e3-728f41581179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:50.502048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e8414-8163-4a41-87e3-728f41581179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:50.503586 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e8414-8163-4a41-87e3-728f41581179 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:50.516104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1262/2562] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:00.103899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:00.105763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:00.187527 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9424-4c3b-474b-ae4b-9e6fead6e144 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:00.192123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:00.193045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:00.193327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:00.193779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] PATH_INFO: `/v3/users/2c2fe7a0459d43e5902c716f5f67b2f9` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:00.194953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2fe7a0459d43e5902c716f5f67b2f9)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:00.197008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:00.432183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2fe7a0459d43e5902c716f5f67b2f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:00.432918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2fe7a0459d43e5902c716f5f67b2f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:00.567408 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2fe7a0459d43e5902c716f5f67b2f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:00.580881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2fe7a0459d43e5902c716f5f67b2f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:00.581990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2fe7a0459d43e5902c716f5f67b2f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:00.615090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1301/2563] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:00 2022] DELETE /identity/v3/users/2c2fe7a0459d43e5902c716f5f67b2f9 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:00.621110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:00.621819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:00.622000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:00.641578 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:00.642885 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:00.716030 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1263/2564] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:00.727851 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:00.729469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:00.803513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2ae6-2ff7-41ba-baf7-2160e04889b4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:00.809447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:00.810637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:00.811176 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:00.811769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:00.838167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:00.839925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:00.852511 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1302/2565] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:01.388895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:01.393016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:01.410758 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1ca9e-1909-43f3-b765-de1bf91d2acd None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:01.421482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:01.421482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:01.421482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:01.421482 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] PATH_INFO: `/v3/projects/8e1a38f352ba409b952bf5f2792b9b63` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:01.423372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1a38f352ba409b952bf5f2792b9b63)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:01.426332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:01.518505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:01.520166 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:01.534553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f103a-1a22-4e95-8050-a8df2f5e6070 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:01.540513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:01.547365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:01.547365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:01.547365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] PATH_INFO: `/v3/users/b7fb1546d36f4c909693dd786a7536a5` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:01.547365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fb1546d36f4c909693dd786a7536a5)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:01.547365 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:01.589627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1a38f352ba409b952bf5f2792b9b63', 'request_id': 'req-f144a4e2-bb95-4967-b607-5c986a50eb0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.598067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1a38f352ba409b952bf5f2792b9b63', 'request_id': 'req-f144a4e2-bb95-4967-b607-5c986a50eb0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.709947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1a38f352ba409b952bf5f2792b9b63', 'request_id': 'req-f144a4e2-bb95-4967-b607-5c986a50eb0f'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.724732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] The token cache is being invalidate because project 8e1a38f352ba409b952bf5f2792b9b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:01.725069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.725756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.727398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1264/2566] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:01 2022] DELETE /identity/v3/projects/8e1a38f352ba409b952bf5f2792b9b63 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:01.731890 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:01.734125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:01.803776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fb1546d36f4c909693dd786a7536a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.805519 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fb1546d36f4c909693dd786a7536a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.834209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144a4e2-bb95-4967-b607-5c986a50eb0f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:01.840650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:01.841152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:01.841505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:01.841878 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] PATH_INFO: `/v3/users/30e2367ab92d4a65a71733983cf62d77` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:01.844125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e2367ab92d4a65a71733983cf62d77)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:01.846204 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:01.892341 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fb1546d36f4c909693dd786a7536a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.901353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fb1546d36f4c909693dd786a7536a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.902186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dde427f1-bf5f-4d85-9307-e71c799fd80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fb1546d36f4c909693dd786a7536a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:01.924943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1303/2567] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:01 2022] DELETE /identity/v3/users/b7fb1546d36f4c909693dd786a7536a5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:38:01.932220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:01.932606 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:01.932965 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:01.955060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:01.957112 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:02.039803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1304/2568] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:02.053145 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:02.058801 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:02.072214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e2367ab92d4a65a71733983cf62d77'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:02.087947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e2367ab92d4a65a71733983cf62d77'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:02.150415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507c18-3772-4efc-a78d-56f517bae012 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:02.152618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:02.153363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:02.153711 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:02.154134 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:02.166879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:02.169117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:02.174386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e2367ab92d4a65a71733983cf62d77'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:02.185477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1305/2569] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:02.198740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e2367ab92d4a65a71733983cf62d77'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:02.199958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e2367ab92d4a65a71733983cf62d77'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:02.211730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1265/2570] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:01 2022] DELETE /identity/v3/users/30e2367ab92d4a65a71733983cf62d77 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:38:02.921384 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:02.927792 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:02.947028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3468b8d-8897-4357-bea6-d8d029908192 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:03.063495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:03.065154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.065619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.066107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] PATH_INFO: `/v3/projects/8cacc789f2ab45cca1a089ec3b6ed65d` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.068444 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cacc789f2ab45cca1a089ec3b6ed65d)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:03.072343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:03.162824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:03.163715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:03.184902 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c51b-76d1-4997-ae27-00cdf5249707 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:03.194093 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:03.195985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.196601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.197394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] PATH_INFO: `/v3/projects/cee8598014074a65a8342ce3b5af7a14` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.200107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee8598014074a65a8342ce3b5af7a14)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:03.204596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:03.244135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cacc789f2ab45cca1a089ec3b6ed65d', 'request_id': 'req-8d5eb481-7bca-4926-99c7-cfef024a2fc9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.252459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cacc789f2ab45cca1a089ec3b6ed65d', 'request_id': 'req-8d5eb481-7bca-4926-99c7-cfef024a2fc9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.315655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cacc789f2ab45cca1a089ec3b6ed65d', 'request_id': 'req-8d5eb481-7bca-4926-99c7-cfef024a2fc9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.329899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] The token cache is being invalidate because project 8cacc789f2ab45cca1a089ec3b6ed65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:03.330357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.331200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8d5eb481-7bca-4926-99c7-cfef024a2fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.333297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1306/2571] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:02 2022] DELETE /identity/v3/projects/8cacc789f2ab45cca1a089ec3b6ed65d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:38:03.340195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01ec4-bb14-4040-b34b-617bcae2bec7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.358760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01ec4-bb14-4040-b34b-617bcae2bec7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.358760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01ec4-bb14-4040-b34b-617bcae2bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.364369 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee8598014074a65a8342ce3b5af7a14', 'request_id': 'req-c4cee933-4799-417d-9633-19cc8f0bbee9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.371933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-dda01ec4-bb14-4040-b34b-617bcae2bec7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:03.374914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dda01ec4-bb14-4040-b34b-617bcae2bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:03.375217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee8598014074a65a8342ce3b5af7a14', 'request_id': 'req-c4cee933-4799-417d-9633-19cc8f0bbee9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.451303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1307/2572] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:03.458304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee8598014074a65a8342ce3b5af7a14', 'request_id': 'req-c4cee933-4799-417d-9633-19cc8f0bbee9'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.460149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3606a-4d2e-4f66-a2e1-95c16c58325a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.460555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3606a-4d2e-4f66-a2e1-95c16c58325a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.460999 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3606a-4d2e-4f66-a2e1-95c16c58325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.476759 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] The token cache is being invalidate because project cee8598014074a65a8342ce3b5af7a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:03.477635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.478924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.481058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1266/2573] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:03 2022] DELETE /identity/v3/projects/cee8598014074a65a8342ce3b5af7a14 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:03.487643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:03.489708 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:03.489933 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-80f3606a-4d2e-4f66-a2e1-95c16c58325a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:03.491674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-80f3606a-4d2e-4f66-a2e1-95c16c58325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:03.505200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1308/2574] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:03.510296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3606a-4d2e-4f66-a2e1-95c16c58325a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:03.517619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cee933-4799-417d-9633-19cc8f0bbee9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:03.525131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3606a-4d2e-4f66-a2e1-95c16c58325a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:03.528281 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:03.530232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.530232 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.530714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] PATH_INFO: `/v3/users/73235282fea5488dbc6b080126a46d4b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.532840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:03.533239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73235282fea5488dbc6b080126a46d4b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:03.534086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.534618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.535071 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.536186 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:38:03.536486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:03.536832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:03.539347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:03.557102 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1309/2575] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:38:03.562659 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:03.587279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9651-f502-4aeb-8598-390314219d25 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:03.589412 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:03.590504 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.591011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.591503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.593445 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:03.596944 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:03.805799 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1310/2576] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:38:03 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:03.810449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:03.881230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73235282fea5488dbc6b080126a46d4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.894018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73235282fea5488dbc6b080126a46d4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.897201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81cda3-9e22-4d47-ab7d-6dabafccfa40 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:03.903626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:03.904560 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:03.905135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:03.905432 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:03.906218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:03.908728 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:03.966863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73235282fea5488dbc6b080126a46d4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.990697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73235282fea5488dbc6b080126a46d4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:03.991725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73235282fea5488dbc6b080126a46d4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:04.001336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1267/2577] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:03 2022] DELETE /identity/v3/users/73235282fea5488dbc6b080126a46d4b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:04.014332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1311/2578] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:38:03 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:04.018355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.020534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:04.121611 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaa5ba-89c4-4631-a1d6-2675ab8a6816 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.128187 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:04.128957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.129245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.129524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.130285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:04.132174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:04.146854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1268/2579] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:38:04.151051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.169480 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c443-26bd-49d8-a6ce-25b0f2247905 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.178378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0958538-3807-41d8-b2bc-c6da70e7ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:04.181397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958538-3807-41d8-b2bc-c6da70e7ae9d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.181397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958538-3807-41d8-b2bc-c6da70e7ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.181397 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958538-3807-41d8-b2bc-c6da70e7ae9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.182187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0958538-3807-41d8-b2bc-c6da70e7ae9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:04.185194 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0958538-3807-41d8-b2bc-c6da70e7ae9d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:04.206774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1312/2580] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:04.211702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.222763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f86a8-130d-4ee2-bb41-d92f670915b5 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.227865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:04.228798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.229085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.229359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] PATH_INFO: `/v3/projects/b2695f385ee44890a4ccee5bcde6fb07/users/1bb4b2d604114dfebc1761582049cfd8/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.246955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2695f385ee44890a4ccee5bcde6fb07, user_id=1bb4b2d604114dfebc1761582049cfd8, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:04.250435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:04.356350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1269/2581] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:38:04 2022] PUT /identity/v3/projects/b2695f385ee44890a4ccee5bcde6fb07/users/1bb4b2d604114dfebc1761582049cfd8/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:04.365830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.366131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.366392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.404105 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] MFA Rules not processed for user `1bb4b2d604114dfebc1761582049cfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:04.405934 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:04.501262 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1313/2582] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:04.505793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.592260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c65e4-17da-4190-b0ed-4912c4fbea3a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.598253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:04.599094 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.599429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.599848 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.600626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:04.602879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:04.610330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.612043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:04.626875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11900-2c0a-44b8-8b7c-6ec71ed25819 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.632645 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:04.633655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.634008 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.634294 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] PATH_INFO: `/v3/projects/65525c0365b5400ca5a1d55e55e90060` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.636085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65525c0365b5400ca5a1d55e55e90060)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:04.638899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:04.706256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1270/2583] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:04.710626 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.799370 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932e52a-e394-419a-8c87-88833a0e1e98 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.804859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:04.805566 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.805952 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.806252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.806950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:04.808976 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:04.838573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65525c0365b5400ca5a1d55e55e90060', 'request_id': 'req-a768810f-d03e-483f-b28e-92a097a0ed24'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:04.846402 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65525c0365b5400ca5a1d55e55e90060', 'request_id': 'req-a768810f-d03e-483f-b28e-92a097a0ed24'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:04.911686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1271/2584] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:38:04 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:04.917076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.930170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e3bd0-d284-4391-80a1-94ad72973952 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.932452 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65525c0365b5400ca5a1d55e55e90060', 'request_id': 'req-a768810f-d03e-483f-b28e-92a097a0ed24'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:04.949329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] The token cache is being invalidate because project 65525c0365b5400ca5a1d55e55e90060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:04.949735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:04.950798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a768810f-d03e-483f-b28e-92a097a0ed24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:04.953589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1314/2585] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:04 2022] DELETE /identity/v3/projects/65525c0365b5400ca5a1d55e55e90060 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:04.959522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb19a3-cd2c-455c-a7d3-bd29445c086e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.959943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb19a3-cd2c-455c-a7d3-bd29445c086e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.960328 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb19a3-cd2c-455c-a7d3-bd29445c086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.984869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-34eb19a3-cd2c-455c-a7d3-bd29445c086e None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:04.986497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-34eb19a3-cd2c-455c-a7d3-bd29445c086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:05.031681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.032388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.032680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.032961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.033716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.035567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.053393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1272/2586] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:38:05.053906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.056154 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:05.072853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6c80b-c154-4e16-b339-73992680eb7a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.079957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.080792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.081181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.081559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.082413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.085004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.091859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1315/2587] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:05.099709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1273/2588] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:05.105154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced047-65c0-4bdb-977a-b35b37e03146 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.105567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced047-65c0-4bdb-977a-b35b37e03146 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.105967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced047-65c0-4bdb-977a-b35b37e03146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.106838 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.123082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c709b2-bced-4a46-833c-323bb9498c72 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.128566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e7ced047-65c0-4bdb-977a-b35b37e03146 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:05.129814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e7ced047-65c0-4bdb-977a-b35b37e03146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:05.130650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0010b8b-f22e-4a80-9bf3-27022a620f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.131831 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010b8b-f22e-4a80-9bf3-27022a620f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.132325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010b8b-f22e-4a80-9bf3-27022a620f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.132773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010b8b-f22e-4a80-9bf3-27022a620f45 admin admin] PATH_INFO: `/v3/projects/12017704a8944d01ae48a036510f3968/users/ac10fc0af0c444f99e23652eb1a3f93d/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.140588 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1316/2589] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:05.145770 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced047-65c0-4bdb-977a-b35b37e03146 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.154876 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0010b8b-f22e-4a80-9bf3-27022a620f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12017704a8944d01ae48a036510f3968, user_id=ac10fc0af0c444f99e23652eb1a3f93d, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.158032 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0010b8b-f22e-4a80-9bf3-27022a620f45 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.158797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced047-65c0-4bdb-977a-b35b37e03146 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.167151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.168180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.168676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.169179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.170547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:38:05.171277 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.174599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.199544 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1317/2590] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:38:05.203624 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.221554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984dfd-6000-4711-be9e-961f2a13c0d1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.230316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.231450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.231996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.232406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.233820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.237446 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.258541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1274/2591] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:38:05 2022] PUT /identity/v3/projects/12017704a8944d01ae48a036510f3968/users/ac10fc0af0c444f99e23652eb1a3f93d/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:38:05.274762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65ddd-1e94-4a48-aa81-a3b03ad04d9a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.275084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65ddd-1e94-4a48-aa81-a3b03ad04d9a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.275635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65ddd-1e94-4a48-aa81-a3b03ad04d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.323998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e8d65ddd-1e94-4a48-aa81-a3b03ad04d9a None None] MFA Rules not processed for user `ac10fc0af0c444f99e23652eb1a3f93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:05.326135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e8d65ddd-1e94-4a48-aa81-a3b03ad04d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:05.390486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1318/2592] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:38:05 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:05.394862 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.417766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1275/2593] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:05.423638 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d65ddd-1e94-4a48-aa81-a3b03ad04d9a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.472529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894652d-3834-46d5-b2e6-a8eaf217c46f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.477989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.478696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.478980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.479264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.480031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.482038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.510807 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d65ddd-1e94-4a48-aa81-a3b03ad04d9a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.516054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.516793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.517081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.517358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.518079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.520062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.607742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1319/2594] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:38:05 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:05.614107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.625724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fefab-dd1e-438c-8aee-e4ab269537b4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.630995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.631739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.632032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.632357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.633082 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.634747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.650743 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1320/2595] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:38:05.651016 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1276/2596] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:38:05 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:05.654501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.655786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.671355 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2204c-7c24-4671-9c12-b3ecba665ca0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.762056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd598a-fa79-46c2-9ce0-c38adb4d0765 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.768678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.769560 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.769864 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.770269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.770897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.771119 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.771987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.772369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.772790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.773160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.773818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.776477 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.791005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1277/2597] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:05.792573 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.804591 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5c5a7-79f1-4122-b8ab-67d1bee38f3d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.809778 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.810716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.811012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.811343 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] PATH_INFO: `/v3/projects/bdcfcfff9e0e498998e18879c944cd35/users/d95c20a6d9eb4137babf95549507c970/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.830339 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcfcfff9e0e498998e18879c944cd35, user_id=d95c20a6d9eb4137babf95549507c970, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.833259 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.893597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1321/2598] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:38:05 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:05.898638 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.910729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b070f79-33a0-4d7a-82da-06513c4a24f3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:05.916091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9aaa-ea65-40e1-ba2f-368bebbc6635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:05.927345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9aaa-ea65-40e1-ba2f-368bebbc6635 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.927345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9aaa-ea65-40e1-ba2f-368bebbc6635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.927345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9aaa-ea65-40e1-ba2f-368bebbc6635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.927345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9aaa-ea65-40e1-ba2f-368bebbc6635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:05.927345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9aaa-ea65-40e1-ba2f-368bebbc6635 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:05.928210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1278/2599] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:38:05 2022] PUT /identity/v3/projects/bdcfcfff9e0e498998e18879c944cd35/users/d95c20a6d9eb4137babf95549507c970/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:38:05.932259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1322/2600] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:38:05.937628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:05.943159 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:05.943609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:05.943900 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:05.982481 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] MFA Rules not processed for user `d95c20a6d9eb4137babf95549507c970`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:05.985288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:06.021423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8c6a0-44e8-488a-8cfb-ad2e46c61571 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:06.027412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:06.028650 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:06.029130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:06.029484 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] PATH_INFO: `/v3/projects/e6cbb6ab35cd47abaf320b6a84c91159/users/a5be7ef996644172b9a0ea3792270893/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:06.055909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cbb6ab35cd47abaf320b6a84c91159, user_id=a5be7ef996644172b9a0ea3792270893, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:06.061125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:06.080150 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1323/2601] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:06.100401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:06.102329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:06.151879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1279/2602] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:38:05 2022] PUT /identity/v3/projects/e6cbb6ab35cd47abaf320b6a84c91159/users/a5be7ef996644172b9a0ea3792270893/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:06.158873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:06.176339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353447f-7ac9-4e0e-bd36-562493414e40 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:06.239031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ab1c5-acb8-4db2-9951-29695d67ff94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc69b41ea4d6456f9532cee386265e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:06.239986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab1c5-acb8-4db2-9951-29695d67ff94 service glance] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:06.240337 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab1c5-acb8-4db2-9951-29695d67ff94 service glance] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:06.240679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab1c5-acb8-4db2-9951-29695d67ff94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:06.256056 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d265-a61f-4a1f-a7a6-f947a1dbf394 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:06.261374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:06.262437 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:06.262637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:06.262939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:06.263821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:06.265533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:06.286125 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1280/2603] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:06.287635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:06.302563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51157ddb-f812-4049-9d4b-036d82e30057 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:06.308927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:06.310174 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:06.310613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:06.311046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] PATH_INFO: `/v3/projects/e6cbb6ab35cd47abaf320b6a84c91159/users/a5be7ef996644172b9a0ea3792270893/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:06.315576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cbb6ab35cd47abaf320b6a84c91159, user_id=a5be7ef996644172b9a0ea3792270893, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:06.320647 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:06.324154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab1c5-acb8-4db2-9951-29695d67ff94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:06.326044 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab1c5-acb8-4db2-9951-29695d67ff94 service glance] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:06.340079 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1324/2604] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:38:06.343541 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1281/2605] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:38:06 2022] PUT /identity/v3/projects/e6cbb6ab35cd47abaf320b6a84c91159/users/a5be7ef996644172b9a0ea3792270893/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:38:06.359017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59547-c201-4707-9be1-ccc1636fec00 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:06.359516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59547-c201-4707-9be1-ccc1636fec00 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:06.359987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59547-c201-4707-9be1-ccc1636fec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:06.406856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0cd59547-c201-4707-9be1-ccc1636fec00 None None] MFA Rules not processed for user `a5be7ef996644172b9a0ea3792270893`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:06.408789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0cd59547-c201-4707-9be1-ccc1636fec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:06.553455 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1325/2606] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:06.562475 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:06.564603 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:06.646200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505c00e-dcf3-4565-8bff-4a4e36ce9839 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:06.651939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:06.653001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:06.653465 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:06.653920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:06.669304 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:06.671015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:06.682422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1282/2607] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:38:08.157191 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd59547-c201-4707-9be1-ccc1636fec00 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:08.171730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd59547-c201-4707-9be1-ccc1636fec00 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:08.179260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:08.181695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:08.182482 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:08.183727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:08.188421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:08.275729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:08.277392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:08.289676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1326/2608] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:14.070721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:14.072660 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:14.086762 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778ff0b-fcea-40d8-b2f1-ad04ca3e8ba5 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:14.091763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f29b-035d-4683-add0-2b5b85a5185d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:14.093105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f29b-035d-4683-add0-2b5b85a5185d service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:14.093453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f29b-035d-4683-add0-2b5b85a5185d service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:14.093789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f29b-035d-4683-add0-2b5b85a5185d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:14.162627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f29b-035d-4683-add0-2b5b85a5185d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:14.164463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f29b-035d-4683-add0-2b5b85a5185d service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:14.175367 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1283/2609] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:19.098383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:19.167420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a6e5-6193-4aa6-916f-95d5d10af9ed service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:19.173015 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:19.173996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:19.174334 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:19.174669 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] PATH_INFO: `/v3/users/1bb4b2d604114dfebc1761582049cfd8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:19.176141 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb4b2d604114dfebc1761582049cfd8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:19.178439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:19.397913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb4b2d604114dfebc1761582049cfd8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:19.400763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb4b2d604114dfebc1761582049cfd8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:19.463136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb4b2d604114dfebc1761582049cfd8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:19.472074 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb4b2d604114dfebc1761582049cfd8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:19.472849 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb4b2d604114dfebc1761582049cfd8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:19.490532 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1327/2610] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:19 2022] DELETE /identity/v3/users/1bb4b2d604114dfebc1761582049cfd8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:19.495714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:19.504337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:19.504337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:19.515382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:19.516627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:19.616982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1284/2611] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:19.632765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:19.634410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:19.700319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79f5a-70c8-4bed-b3a4-cc99ad34b8c3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:19.704805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:19.705487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:19.705927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:19.706215 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:19.716739 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:19.718228 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:19.728832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1328/2612] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:38:20.238699 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:20.240420 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:20.257979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38e03a-451e-4b2b-bbd0-ef417ea25ac6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:20.267381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:20.268983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:20.269549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:20.270047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] PATH_INFO: `/v3/projects/b2695f385ee44890a4ccee5bcde6fb07` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:20.272360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2695f385ee44890a4ccee5bcde6fb07)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:20.276406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:20.414128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2695f385ee44890a4ccee5bcde6fb07', 'request_id': 'req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.423049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2695f385ee44890a4ccee5bcde6fb07', 'request_id': 'req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.531780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2695f385ee44890a4ccee5bcde6fb07', 'request_id': 'req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.545651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] The token cache is being invalidate because project b2695f385ee44890a4ccee5bcde6fb07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:20.545956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.546616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.548313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1285/2613] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:20 2022] DELETE /identity/v3/projects/b2695f385ee44890a4ccee5bcde6fb07 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:20.552641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:20.563718 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77833868-7fbe-48ed-8dec-56b90fa09703 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:20.628027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:20.629135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:20.629420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:20.629702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] PATH_INFO: `/v3/users/ac10fc0af0c444f99e23652eb1a3f93d` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:20.630980 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac10fc0af0c444f99e23652eb1a3f93d)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:20.633268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:20.873949 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac10fc0af0c444f99e23652eb1a3f93d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.874509 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac10fc0af0c444f99e23652eb1a3f93d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.954575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac10fc0af0c444f99e23652eb1a3f93d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.962977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac10fc0af0c444f99e23652eb1a3f93d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.963906 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac10fc0af0c444f99e23652eb1a3f93d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:20.986309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1329/2614] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:20 2022] DELETE /identity/v3/users/ac10fc0af0c444f99e23652eb1a3f93d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:21.470408 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:21.472242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:21.491381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418def6-23c6-4a55-b3d3-35b3d10f0c4b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:21.561906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:21.563461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:21.564007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:21.564508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] PATH_INFO: `/v3/projects/12017704a8944d01ae48a036510f3968` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:21.567048 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] RBAC: Authorizing `identity:delete_project(project_id=12017704a8944d01ae48a036510f3968)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:21.570676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:21.712364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12017704a8944d01ae48a036510f3968', 'request_id': 'req-dc566211-b5d8-4046-ae92-8f5f715c70db'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:21.719738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12017704a8944d01ae48a036510f3968', 'request_id': 'req-dc566211-b5d8-4046-ae92-8f5f715c70db'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:21.812284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12017704a8944d01ae48a036510f3968', 'request_id': 'req-dc566211-b5d8-4046-ae92-8f5f715c70db'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:21.825879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] The token cache is being invalidate because project 12017704a8944d01ae48a036510f3968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:21.826769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:21.827423 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:21.829086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1286/2615] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:21 2022] DELETE /identity/v3/projects/12017704a8944d01ae48a036510f3968 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:21.835027 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:21.836852 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:21.852022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d22626-d504-4115-b82e-77f105b18206 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:21.912483 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:21.913522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:21.913848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:21.914167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] PATH_INFO: `/v3/users/a5be7ef996644172b9a0ea3792270893` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:21.915521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5be7ef996644172b9a0ea3792270893)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:21.917706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:22.157422 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5be7ef996644172b9a0ea3792270893'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:22.158117 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5be7ef996644172b9a0ea3792270893'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:22.343268 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5be7ef996644172b9a0ea3792270893'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:22.350593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5be7ef996644172b9a0ea3792270893'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:22.351220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7f766dde-a6cb-4e83-9308-aed18198dccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5be7ef996644172b9a0ea3792270893'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:22.368143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1330/2616] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:21 2022] DELETE /identity/v3/users/a5be7ef996644172b9a0ea3792270893 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:22.852726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:22.857504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:22.867240 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566211-b5d8-4046-ae92-8f5f715c70db admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:22.929951 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:22.930834 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:22.931131 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:22.931401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] PATH_INFO: `/v3/projects/e6cbb6ab35cd47abaf320b6a84c91159` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:22.932805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6cbb6ab35cd47abaf320b6a84c91159)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:22.934695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:23.106260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6cbb6ab35cd47abaf320b6a84c91159', 'request_id': 'req-94a26de3-18fa-43f7-942e-029137e85189'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:23.117107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6cbb6ab35cd47abaf320b6a84c91159', 'request_id': 'req-94a26de3-18fa-43f7-942e-029137e85189'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:23.211881 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6cbb6ab35cd47abaf320b6a84c91159', 'request_id': 'req-94a26de3-18fa-43f7-942e-029137e85189'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:23.223671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] The token cache is being invalidate because project e6cbb6ab35cd47abaf320b6a84c91159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:23.225686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:23.225686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-94a26de3-18fa-43f7-942e-029137e85189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:23.226245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1287/2617] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:22 2022] DELETE /identity/v3/projects/e6cbb6ab35cd47abaf320b6a84c91159 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:23.234045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d6ff3-46fa-4d95-968a-1c1661aedd6a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.234860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d6ff3-46fa-4d95-968a-1c1661aedd6a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.234860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d6ff3-46fa-4d95-968a-1c1661aedd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.255573 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-708d6ff3-46fa-4d95-968a-1c1661aedd6a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:23.256921 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-708d6ff3-46fa-4d95-968a-1c1661aedd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:23.324126 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1331/2618] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:23.333916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e37e6-df1d-49be-b1a2-dfa9a9addd38 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.334208 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e37e6-df1d-49be-b1a2-dfa9a9addd38 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.334490 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e37e6-df1d-49be-b1a2-dfa9a9addd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.355277 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a76e37e6-df1d-49be-b1a2-dfa9a9addd38 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:23.356561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a76e37e6-df1d-49be-b1a2-dfa9a9addd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:23.365075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1288/2619] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:23.369926 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d6ff3-46fa-4d95-968a-1c1661aedd6a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:23.380901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d6ff3-46fa-4d95-968a-1c1661aedd6a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:23.385789 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:23.386494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.386875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.387152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.387993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:38:23.388339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:23.390635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:23.404974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1332/2620] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:38:23.409744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e37e6-df1d-49be-b1a2-dfa9a9addd38 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:23.419662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e37e6-df1d-49be-b1a2-dfa9a9addd38 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:23.424609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:23.425413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.425702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.425987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.426712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:23.428717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:23.553991 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1289/2621] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:38:23 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:23.555111 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:23.566316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9627f-201b-47a0-8b0a-6bf425c6424f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:23.628023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:23.628781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.629066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.629344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.630038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:23.632081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:23.839780 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1333/2622] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:38:23 2022] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:23.845014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:23.856405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48ac28-1e6b-4815-b813-ae50ffbc672c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:23.862033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:23.862717 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.866173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.866173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.866173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:23.866173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:23.879714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1290/2623] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:23.884702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:23.902914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ec43a-9664-4dc7-a415-23b32fdb5869 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:23.909615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba4820-361f-4072-83af-4c2db37f52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:23.911936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba4820-361f-4072-83af-4c2db37f52a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.911936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba4820-361f-4072-83af-4c2db37f52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.911936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba4820-361f-4072-83af-4c2db37f52a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.911936 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba4820-361f-4072-83af-4c2db37f52a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:23.913593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba4820-361f-4072-83af-4c2db37f52a1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:23.925287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1334/2624] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:23.929764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:23.941362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f1d77-fb8b-471b-beb7-0d06e1e3a095 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:23.946320 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:23.947312 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:23.947722 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:23.948071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] PATH_INFO: `/v3/projects/e680c24b57824d6686b37f86fd1ff881/users/d862997fd89f498c9266548f689ca82d/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:23.965856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e680c24b57824d6686b37f86fd1ff881, user_id=d862997fd89f498c9266548f689ca82d, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:23.969690 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:24.104141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1291/2625] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:38:23 2022] PUT /identity/v3/projects/e680c24b57824d6686b37f86fd1ff881/users/d862997fd89f498c9266548f689ca82d/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:24.109672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f37a-65d1-4865-9721-3cb38a2f95bd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:24.110020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f37a-65d1-4865-9721-3cb38a2f95bd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:24.110312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f37a-65d1-4865-9721-3cb38a2f95bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:24.128945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0f76f37a-65d1-4865-9721-3cb38a2f95bd None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:24.130181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0f76f37a-65d1-4865-9721-3cb38a2f95bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:24.198469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1335/2626] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:24.215378 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:24.218364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:24.302297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8b6c-c36d-451c-9e77-1351cf301c52 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:24.306540 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:24.307331 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:24.307659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:24.307940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:24.323645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:24.326588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:24.338008 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1292/2627] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:25.812736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035327c7-67dd-4ad4-99ab-2717a04ed99e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:25.813324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035327c7-67dd-4ad4-99ab-2717a04ed99e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:25.813447 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035327c7-67dd-4ad4-99ab-2717a04ed99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:25.845807 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-035327c7-67dd-4ad4-99ab-2717a04ed99e None None] MFA Rules not processed for user `d862997fd89f498c9266548f689ca82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:25.848100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-035327c7-67dd-4ad4-99ab-2717a04ed99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:25.928667 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1336/2628] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:25.941029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:25.942652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:26.005214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b87412-d586-47ee-9296-237b25302cd1 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:26.008771 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:26.009456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:26.009737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:26.010014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:26.019066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:26.020552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:26.030867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1293/2629] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:28.953963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.962942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.962942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.975260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] MFA Rules not processed for user `d862997fd89f498c9266548f689ca82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:28.976615 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:28.984120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1337/2630] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:40.979428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:40.981078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:41.080071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36794-c3a7-46ab-a74c-f9b58a9e43b1 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:41.085928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad160f-955a-4ef8-8543-71da58946512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:41.086598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad160f-955a-4ef8-8543-71da58946512 service placement] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:41.092243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad160f-955a-4ef8-8543-71da58946512 service placement] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:41.092243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad160f-955a-4ef8-8543-71da58946512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:41.092243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-fdad160f-955a-4ef8-8543-71da58946512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:41.102793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad160f-955a-4ef8-8543-71da58946512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:41.104594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad160f-955a-4ef8-8543-71da58946512 service placement] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:41.118433 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1294/2631] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:42.303941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:42.304571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:42.328198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b80dd-2763-47de-81fe-84b15ba7b1b8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:42.333843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:42.335073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:42.335764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:42.336206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] PATH_INFO: `/v3/users/d95c20a6d9eb4137babf95549507c970` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:42.337827 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95c20a6d9eb4137babf95549507c970)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:42.340541 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:42.526727 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95c20a6d9eb4137babf95549507c970'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:42.527454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95c20a6d9eb4137babf95549507c970'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:42.628320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95c20a6d9eb4137babf95549507c970'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:42.637053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95c20a6d9eb4137babf95549507c970'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:42.637820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95c20a6d9eb4137babf95549507c970'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:42.672381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1338/2632] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:38:42 2022] DELETE /identity/v3/users/d95c20a6d9eb4137babf95549507c970 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:42.673920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:42.674412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:42.674521 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:42.692258 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:42.693602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:42.764255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1295/2633] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:38:42.773864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:42.775303 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:42.841927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170da15-beea-4e03-975a-aa57031c2837 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:42.845604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623fcf-ed0c-4df0-9862-fd62a9f33d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:42.846249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623fcf-ed0c-4df0-9862-fd62a9f33d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:42.846526 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623fcf-ed0c-4df0-9862-fd62a9f33d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:42.846798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623fcf-ed0c-4df0-9862-fd62a9f33d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:42.855937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623fcf-ed0c-4df0-9862-fd62a9f33d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:42.857905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623fcf-ed0c-4df0-9862-fd62a9f33d0c service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:42.867288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1339/2634] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:43.340624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:43.343596 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:43.361255 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48b5e-7746-46fc-894a-8558d02a88b0 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:43.366737 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:43.367677 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:43.367959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:43.368230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] PATH_INFO: `/v3/projects/bdcfcfff9e0e498998e18879c944cd35` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:43.369525 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdcfcfff9e0e498998e18879c944cd35)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:43.371503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:43.508109 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdcfcfff9e0e498998e18879c944cd35', 'request_id': 'req-5c492b42-2aed-407a-8636-7182da9687e6'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:43.514641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdcfcfff9e0e498998e18879c944cd35', 'request_id': 'req-5c492b42-2aed-407a-8636-7182da9687e6'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:43.593569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdcfcfff9e0e498998e18879c944cd35', 'request_id': 'req-5c492b42-2aed-407a-8636-7182da9687e6'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:43.605199 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] The token cache is being invalidate because project bdcfcfff9e0e498998e18879c944cd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:43.605486 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:43.606149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-5c492b42-2aed-407a-8636-7182da9687e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:43.607889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1296/2635] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:38:43 2022] DELETE /identity/v3/projects/bdcfcfff9e0e498998e18879c944cd35 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:43.612871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d98e-1153-4421-a5fa-d43409193e15 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:43.613415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d98e-1153-4421-a5fa-d43409193e15 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:43.613510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d98e-1153-4421-a5fa-d43409193e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:43.632797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-53b8d98e-1153-4421-a5fa-d43409193e15 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:43.634034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-53b8d98e-1153-4421-a5fa-d43409193e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:43.699671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1340/2636] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:43.710786 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6981d1-329b-430a-9d5c-9790d660c5fb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:43.711352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6981d1-329b-430a-9d5c-9790d660c5fb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:43.711822 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6981d1-329b-430a-9d5c-9790d660c5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:43.735598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bd6981d1-329b-430a-9d5c-9790d660c5fb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:43.737088 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bd6981d1-329b-430a-9d5c-9790d660c5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:43.747046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1297/2637] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:43.754928 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d98e-1153-4421-a5fa-d43409193e15 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:43.762417 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d98e-1153-4421-a5fa-d43409193e15 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:43.767521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:43.768206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:43.768489 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:43.768842 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:43.769630 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:38:43.769941 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:43.771602 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:43.784174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1341/2638] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:38:43.796295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6981d1-329b-430a-9d5c-9790d660c5fb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:43.807913 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6981d1-329b-430a-9d5c-9790d660c5fb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:43.814983 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:43.815920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:43.816238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:43.816543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:43.817351 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:43.819652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:43.954409 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1298/2639] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:38:43 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:43.955893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:43.969300 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a4990-bfe4-488a-af0a-15f8b4b65578 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:44.069816 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:44.070500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:44.071307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:44.071307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:44.072061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:44.074578 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:44.242314 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1342/2640] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:38:43 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:44.249866 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:44.260702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27465-fb8f-4297-ae63-5219596ecd2e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:44.266824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:44.267636 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:44.267965 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:44.268248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:44.269007 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:44.270688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:44.283836 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1299/2641] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:38:44.288264 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:44.299926 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3ef68-7887-4e67-9a84-b68a81ab81c9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:44.306183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4cb35-3632-4fc4-80d3-f3fb8089e92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:44.307247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4cb35-3632-4fc4-80d3-f3fb8089e92d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:44.307763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4cb35-3632-4fc4-80d3-f3fb8089e92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:44.308201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4cb35-3632-4fc4-80d3-f3fb8089e92d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:44.309435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4cb35-3632-4fc4-80d3-f3fb8089e92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:44.312295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4cb35-3632-4fc4-80d3-f3fb8089e92d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:44.327017 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1343/2642] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:44.331694 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:44.348547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7425c12-311e-47b3-8f0e-903b9ef91649 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:44.356386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:44.358827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:44.359289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:44.359804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] PATH_INFO: `/v3/projects/3f106cb999cd478c80c2164ba8ceadd6/users/ad95f38cca0e48a8bfd7fdff128e3f13/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:44.388509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f106cb999cd478c80c2164ba8ceadd6, user_id=ad95f38cca0e48a8bfd7fdff128e3f13, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:44.391584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:44.503091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1300/2643] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:38:44 2022] PUT /identity/v3/projects/3f106cb999cd478c80c2164ba8ceadd6/users/ad95f38cca0e48a8bfd7fdff128e3f13/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:44.524174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe79cc-e2b8-4231-bb04-4166ea8b336c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:44.524174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe79cc-e2b8-4231-bb04-4166ea8b336c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:44.524174 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe79cc-e2b8-4231-bb04-4166ea8b336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:44.561524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-25fe79cc-e2b8-4231-bb04-4166ea8b336c None None] MFA Rules not processed for user `ad95f38cca0e48a8bfd7fdff128e3f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:44.563701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-25fe79cc-e2b8-4231-bb04-4166ea8b336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:44.678019 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1344/2644] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:44.692487 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:44.695103 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:44.772925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d0fc-07f6-4625-a64e-c1280970183d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:44.777045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc69b41ea4d6456f9532cee386265e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:44.777741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:44.778026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:44.778307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:44.787743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:44.789379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:44.800275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1301/2645] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:08.020136 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a4b75-4d4e-44c9-960c-92b9e9114383 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:08.021023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a4b75-4d4e-44c9-960c-92b9e9114383 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:08.021023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a4b75-4d4e-44c9-960c-92b9e9114383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:08.043293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c00a4b75-4d4e-44c9-960c-92b9e9114383 None None] MFA Rules not processed for user `5f3bb238d5b3405e8e7e5eb557edf4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:08.045307 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c00a4b75-4d4e-44c9-960c-92b9e9114383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:08.108267 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1345/2646] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:12.570813 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:12.572451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:12.632579 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28802f0b-0f3a-433b-9b10-68553293015f service glance] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:12.637590 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:12.638245 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:12.638530 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:12.638810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:12.640659 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:12.709018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:12.710749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:12.721349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1302/2647] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:24.724591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf099d-30aa-4a0c-9b89-21e0d1bb290f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:24.725529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf099d-30aa-4a0c-9b89-21e0d1bb290f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:24.725529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf099d-30aa-4a0c-9b89-21e0d1bb290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:24.747513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2ccf099d-30aa-4a0c-9b89-21e0d1bb290f None None] MFA Rules not processed for user `2d89e1e4baa44cc0ad28c8dcaef5af76`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:24.748813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2ccf099d-30aa-4a0c-9b89-21e0d1bb290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:24.756260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1346/2648] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:28.816984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:28.913287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cecaf8-2aa4-400c-bd9a-f7142251bfed service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:28.919601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:28.920519 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:28.920803 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:28.921110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] PATH_INFO: `/v3/users/ad95f38cca0e48a8bfd7fdff128e3f13` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:28.925279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad95f38cca0e48a8bfd7fdff128e3f13)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:28.927529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:29.198086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad95f38cca0e48a8bfd7fdff128e3f13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:29.213292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad95f38cca0e48a8bfd7fdff128e3f13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:29.335066 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad95f38cca0e48a8bfd7fdff128e3f13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:29.352631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad95f38cca0e48a8bfd7fdff128e3f13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:29.354089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad95f38cca0e48a8bfd7fdff128e3f13'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:29.364181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1303/2649] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:39:28 2022] DELETE /identity/v3/users/ad95f38cca0e48a8bfd7fdff128e3f13 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:29.370797 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:29.372042 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:29.372418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:29.396987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:29.398173 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:29.479719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1347/2650] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:29.494239 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:29.496985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:29.564891 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154094af-8438-4868-8ad3-30d5b6d5d50b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:29.568727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b838bd-fa9f-4404-8cc4-dd4db5a6ecaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:29.569397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b838bd-fa9f-4404-8cc4-dd4db5a6ecaa service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:29.569680 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b838bd-fa9f-4404-8cc4-dd4db5a6ecaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:29.569961 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b838bd-fa9f-4404-8cc4-dd4db5a6ecaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:29.580335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b838bd-fa9f-4404-8cc4-dd4db5a6ecaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:29.581893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b838bd-fa9f-4404-8cc4-dd4db5a6ecaa service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:29.593928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1304/2651] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:39:30.182170 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:30.183601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:30.197032 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5944e-c483-448b-8b16-811c9a9ccddb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:30.202738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:30.203855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:30.204276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:30.204622 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] PATH_INFO: `/v3/projects/3f106cb999cd478c80c2164ba8ceadd6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:30.205920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f106cb999cd478c80c2164ba8ceadd6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:30.207969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:30.347423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f106cb999cd478c80c2164ba8ceadd6', 'request_id': 'req-b36064c1-05a4-4bec-ae4b-40002561752a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:30.355736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f106cb999cd478c80c2164ba8ceadd6', 'request_id': 'req-b36064c1-05a4-4bec-ae4b-40002561752a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:30.443154 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f106cb999cd478c80c2164ba8ceadd6', 'request_id': 'req-b36064c1-05a4-4bec-ae4b-40002561752a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:30.456371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] The token cache is being invalidate because project 3f106cb999cd478c80c2164ba8ceadd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:30.456641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:30.457218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b36064c1-05a4-4bec-ae4b-40002561752a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:30.459553 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1348/2652] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:39:30 2022] DELETE /identity/v3/projects/3f106cb999cd478c80c2164ba8ceadd6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:30.464924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f5783-4624-4e71-8335-c7b43faddfb7 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:30.465924 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f5783-4624-4e71-8335-c7b43faddfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:30.466461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f5783-4624-4e71-8335-c7b43faddfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:30.487039 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-d68f5783-4624-4e71-8335-c7b43faddfb7 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:30.488260 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d68f5783-4624-4e71-8335-c7b43faddfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:30.557461 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1305/2653] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:30.567130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455db9c-0766-4dbb-b634-b0891dd3867f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:30.567450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455db9c-0766-4dbb-b634-b0891dd3867f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:30.567769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455db9c-0766-4dbb-b634-b0891dd3867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:30.587879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a455db9c-0766-4dbb-b634-b0891dd3867f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:30.589085 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a455db9c-0766-4dbb-b634-b0891dd3867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:30.597967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1349/2654] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:30.602504 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f5783-4624-4e71-8335-c7b43faddfb7 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:30.612857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f5783-4624-4e71-8335-c7b43faddfb7 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:30.618247 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:30.618957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:30.619267 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:30.619580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:30.620329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:39:30.620639 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:30.622868 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:30.635529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1306/2655] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:39:30.640976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455db9c-0766-4dbb-b634-b0891dd3867f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:30.650968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455db9c-0766-4dbb-b634-b0891dd3867f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:30.655832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:30.656506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:30.656793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:30.657075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:30.657795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:30.659742 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:30.799443 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1350/2656] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:39:30 2022] POST /identity/v3/projects => generated 397 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:30.803835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:30.814940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dacf2-160d-4386-ae1d-18ccc42106fb admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:30.875010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:30.875741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:30.876025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:30.876314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:30.877011 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:30.878936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:30.976410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1307/2657] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:39:30 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:30.981230 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:30.992671 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166a73e-3f33-4619-9a41-783cf2d8ba2d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:30.998837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:30.999546 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:30.999836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:31.000115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:31.000854 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:31.002548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:31.014672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1351/2658] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:31.020054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:31.032514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2c70-d20c-469a-b4e6-02bfa6e2df47 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:31.037517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118c8f-a27f-4688-9b15-4278c5d96995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:31.038266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c8f-a27f-4688-9b15-4278c5d96995 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:31.038548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c8f-a27f-4688-9b15-4278c5d96995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:31.038824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c8f-a27f-4688-9b15-4278c5d96995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:31.039592 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94118c8f-a27f-4688-9b15-4278c5d96995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:31.041217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94118c8f-a27f-4688-9b15-4278c5d96995 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:31.052725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1308/2659] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:31.057969 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:31.075856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792581b9-aab7-4fe7-9adb-2052ba7d40ba admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:31.083655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:31.085495 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:31.085994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:31.086487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] PATH_INFO: `/v3/projects/01e2c31241d946b793b13be6ad6f61b2/users/32d431c0186346db89e39e85f70ada66/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:31.113945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e2c31241d946b793b13be6ad6f61b2, user_id=32d431c0186346db89e39e85f70ada66, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:31.119280 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:31.359599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1352/2660] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:39:31 2022] PUT /identity/v3/projects/01e2c31241d946b793b13be6ad6f61b2/users/32d431c0186346db89e39e85f70ada66/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:31.377363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada4c15-f36b-44db-b251-a40d579221da None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:31.377654 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada4c15-f36b-44db-b251-a40d579221da None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:31.377935 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada4c15-f36b-44db-b251-a40d579221da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:31.408070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-bada4c15-f36b-44db-b251-a40d579221da None None] MFA Rules not processed for user `32d431c0186346db89e39e85f70ada66`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:31.410237 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-bada4c15-f36b-44db-b251-a40d579221da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:31.479839 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1309/2661] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:31.491814 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:31.493909 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:31.555295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327f459-c8b7-4a85-80ef-db95c3cc381d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:31.559888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8f3f2-5e82-4d64-9107-5817c1b62553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:31.560609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8f3f2-5e82-4d64-9107-5817c1b62553 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:31.560925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8f3f2-5e82-4d64-9107-5817c1b62553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:31.561201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8f3f2-5e82-4d64-9107-5817c1b62553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:31.572024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8f3f2-5e82-4d64-9107-5817c1b62553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:31.573914 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8f3f2-5e82-4d64-9107-5817c1b62553 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:31.583726 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1353/2662] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:39:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:40.958383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada4c15-f36b-44db-b251-a40d579221da None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:41.023697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada4c15-f36b-44db-b251-a40d579221da None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:41.031374 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:41.032307 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:41.032593 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:41.032879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] PATH_INFO: `/v3/users/32d431c0186346db89e39e85f70ada66` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:41.034129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d431c0186346db89e39e85f70ada66)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:41.036161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:41.282322 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d431c0186346db89e39e85f70ada66'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:41.292058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d431c0186346db89e39e85f70ada66'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:41.466329 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d431c0186346db89e39e85f70ada66'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:41.484065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d431c0186346db89e39e85f70ada66'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:41.485074 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d431c0186346db89e39e85f70ada66'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:41.492477 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1310/2663] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:39:40 2022] DELETE /identity/v3/users/32d431c0186346db89e39e85f70ada66 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:41.497488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f840b0-8342-4084-9616-db0d61800841 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:41.498207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f840b0-8342-4084-9616-db0d61800841 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:41.498207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f840b0-8342-4084-9616-db0d61800841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:41.518318 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-57f840b0-8342-4084-9616-db0d61800841 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:41.519595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-57f840b0-8342-4084-9616-db0d61800841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:41.613366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1354/2664] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:41.625031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:41.626873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:41.700139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6aad1-e5cb-4ec5-9b19-e251ad76fcdf admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:41.705984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd8cb5-5c08-45db-9000-20165dca8205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:41.706695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8cb5-5c08-45db-9000-20165dca8205 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:41.707003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8cb5-5c08-45db-9000-20165dca8205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:41.707287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8cb5-5c08-45db-9000-20165dca8205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:41.720409 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd8cb5-5c08-45db-9000-20165dca8205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:41.722401 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd8cb5-5c08-45db-9000-20165dca8205 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:41.739879 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1311/2665] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:42.191091 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f840b0-8342-4084-9616-db0d61800841 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:42.193604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-57f840b0-8342-4084-9616-db0d61800841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:42.208127 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f840b0-8342-4084-9616-db0d61800841 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:42.216125 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:42.217020 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:42.217418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:42.227165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] PATH_INFO: `/v3/projects/01e2c31241d946b793b13be6ad6f61b2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:42.228676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e2c31241d946b793b13be6ad6f61b2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:42.231219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:42.401130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e2c31241d946b793b13be6ad6f61b2', 'request_id': 'req-a1f6035b-9e93-48a9-bb6b-d4db1971749c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:42.409056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e2c31241d946b793b13be6ad6f61b2', 'request_id': 'req-a1f6035b-9e93-48a9-bb6b-d4db1971749c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:42.494442 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e2c31241d946b793b13be6ad6f61b2', 'request_id': 'req-a1f6035b-9e93-48a9-bb6b-d4db1971749c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:42.507542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] The token cache is being invalidate because project 01e2c31241d946b793b13be6ad6f61b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:42.508597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:42.509122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:42.511155 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1355/2666] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:39:42 2022] DELETE /identity/v3/projects/01e2c31241d946b793b13be6ad6f61b2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:58.625344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.626116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.626116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.644728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] MFA Rules not processed for user `d862997fd89f498c9266548f689ca82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:58.646065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:58.721462 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1312/2667] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:44.193779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:44.195219 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.261559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6035b-9e93-48a9-bb6b-d4db1971749c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:44.265929 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:44.266607 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:44.266893 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:44.267171 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:44.269140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.340053 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:44.341514 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:44.354672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1356/2668] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:44.580527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:44.582363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.644471 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6163e3c-a134-4a2f-9a4b-e33106f0cc5d None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:44.651564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:44.651564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:44.651564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:44.651564 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:44.653396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.670415 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:44.672110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:44.688907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1313/2669] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:53.582599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:53.584119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:53.597833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5760f2-9533-49c0-a486-5bc923866d7c service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:53.603259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:53.603935 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:53.604217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:53.604491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:53.606200 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:53.669468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:53.671139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:53.680101 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1357/2670] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:04.518014 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:04.519483 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:04.530621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5239b-092b-4a36-aa82-a06e0465722d service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:04.534964 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:04.535800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:04.536086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:04.536499 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:04.538544 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:04.602674 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:04.604210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:04.616559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1314/2671] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:08.718765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:08.720566 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:08.736995 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ad4a-9307-4ae7-8c1d-3e849d1f7c4a service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:08.746863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:08.748434 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:08.748905 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:08.749562 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] PATH_INFO: `/v3/users/5f3bb238d5b3405e8e7e5eb557edf4c6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:08.751859 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3bb238d5b3405e8e7e5eb557edf4c6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:08.755784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:08.992418 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3bb238d5b3405e8e7e5eb557edf4c6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:08.993848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3bb238d5b3405e8e7e5eb557edf4c6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.064036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3bb238d5b3405e8e7e5eb557edf4c6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.073517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3bb238d5b3405e8e7e5eb557edf4c6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.074404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bac43ad3-bf66-4966-9e1b-eca68ed05770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3bb238d5b3405e8e7e5eb557edf4c6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.094620 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1358/2672] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:41:08 2022] DELETE /identity/v3/users/5f3bb238d5b3405e8e7e5eb557edf4c6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:09.357472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:09.368895 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964ce61-3644-499a-8162-c670a05e0013 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:09.438539 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:09.439500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:09.439780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:09.440058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] PATH_INFO: `/v3/projects/5d93ed256d64460ca78ab0593d417fb1` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:09.441489 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d93ed256d64460ca78ab0593d417fb1)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:09.443721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:09.601439 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d93ed256d64460ca78ab0593d417fb1', 'request_id': 'req-27c92528-c082-4be4-b0e8-c1683576a9ac'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.608313 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d93ed256d64460ca78ab0593d417fb1', 'request_id': 'req-27c92528-c082-4be4-b0e8-c1683576a9ac'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.709553 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d93ed256d64460ca78ab0593d417fb1', 'request_id': 'req-27c92528-c082-4be4-b0e8-c1683576a9ac'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.722872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] The token cache is being invalidate because project 5d93ed256d64460ca78ab0593d417fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:09.723159 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.723850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-27c92528-c082-4be4-b0e8-c1683576a9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:09.725440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1315/2673] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:41:09 2022] DELETE /identity/v3/projects/5d93ed256d64460ca78ab0593d417fb1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:09.732565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd509948-ca67-47ef-962a-63fe45e8cf17 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:09.733130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd509948-ca67-47ef-962a-63fe45e8cf17 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:09.733130 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd509948-ca67-47ef-962a-63fe45e8cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:09.751946 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fd509948-ca67-47ef-962a-63fe45e8cf17 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:09.753193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fd509948-ca67-47ef-962a-63fe45e8cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:09.822152 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1359/2674] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:09.833212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d5a7-9bfc-4f0a-bcd3-efe631ca9058 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:09.833506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d5a7-9bfc-4f0a-bcd3-efe631ca9058 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:09.833797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d5a7-9bfc-4f0a-bcd3-efe631ca9058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:09.854262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e169d5a7-9bfc-4f0a-bcd3-efe631ca9058 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:09.855534 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e169d5a7-9bfc-4f0a-bcd3-efe631ca9058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:09.864360 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1316/2675] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:09.868998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd509948-ca67-47ef-962a-63fe45e8cf17 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:09.879670 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd509948-ca67-47ef-962a-63fe45e8cf17 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:09.886296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:09.886993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:09.887286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:09.887647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:09.888404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:41:09.888787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:09.890576 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:09.904730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1360/2676] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:41:09.911563 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169d5a7-9bfc-4f0a-bcd3-efe631ca9058 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:09.923332 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169d5a7-9bfc-4f0a-bcd3-efe631ca9058 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:09.928702 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:09.929397 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:09.929688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:09.929981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:09.930906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:09.933137 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:10.026719 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1317/2677] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:41:09 2022] POST /identity/v3/projects => generated 401 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:41:10.031377 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:10.042554 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab23a0d-d807-4567-834d-161cd14130f3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:10.111456 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:10.112090 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:10.112380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:10.112664 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:10.113372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:10.115380 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:10.195672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1361/2678] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:41:10 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:41:10.200791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:10.213472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f0b3d-0a31-459f-abb6-bd500745ff31 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:10.219417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:10.220139 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:10.220424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:10.220707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:10.221448 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:10.223082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:10.234907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1318/2679] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:10.239945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:10.256912 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833600f-742f-4a7e-9214-242c8c102d8e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:10.265713 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136559d-4a95-45c5-a1d2-eadf7f34d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:10.266846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136559d-4a95-45c5-a1d2-eadf7f34d153 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:10.267347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136559d-4a95-45c5-a1d2-eadf7f34d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:10.267873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136559d-4a95-45c5-a1d2-eadf7f34d153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:10.269242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136559d-4a95-45c5-a1d2-eadf7f34d153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:10.272351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136559d-4a95-45c5-a1d2-eadf7f34d153 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:10.286052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1362/2680] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:41:10.290915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:10.301112 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9637a7-c136-4c3a-9b3d-eb7274ad43e7 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:10.306618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:10.315684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:10.315684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:10.315684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] PATH_INFO: `/v3/projects/793a2afc56d84e3ea3a2d286445f4c8e/users/c31b29b0e5794f8183ffdd8552d3ecac/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:10.327297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] RBAC: Authorizing `identity:create_grant(project_id=793a2afc56d84e3ea3a2d286445f4c8e, user_id=c31b29b0e5794f8183ffdd8552d3ecac, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:10.329986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:10.435095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1319/2681] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:10 2022] PUT /identity/v3/projects/793a2afc56d84e3ea3a2d286445f4c8e/users/c31b29b0e5794f8183ffdd8552d3ecac/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:10.441239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bedf4-7aa9-44a3-bed8-e8cbd81781f1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:10.441536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bedf4-7aa9-44a3-bed8-e8cbd81781f1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:10.441813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bedf4-7aa9-44a3-bed8-e8cbd81781f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:10.462011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5d2bedf4-7aa9-44a3-bed8-e8cbd81781f1 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:10.463242 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5d2bedf4-7aa9-44a3-bed8-e8cbd81781f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:10.523634 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1363/2682] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:10.533514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:10.535317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:10.601880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2956b-cd61-4368-a963-37348f0b44da admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:10.606508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:10.607160 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:10.607447 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:10.607764 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:10.618681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:10.620111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:10.629904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1320/2683] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:11.912590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5125a3-b8ce-4e64-bdbc-826aead6fab9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:11.913421 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5125a3-b8ce-4e64-bdbc-826aead6fab9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:11.913639 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5125a3-b8ce-4e64-bdbc-826aead6fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:11.943181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4a5125a3-b8ce-4e64-bdbc-826aead6fab9 None None] MFA Rules not processed for user `c31b29b0e5794f8183ffdd8552d3ecac`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:11.944524 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4a5125a3-b8ce-4e64-bdbc-826aead6fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:12.028356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1364/2684] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:12.032947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:12.044044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a7ea-1ff2-4a25-bf04-efe527353fd0 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:12.049019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:12.049810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:12.051552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:12.051552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:12.051552 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:12.053180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:12.189570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1321/2685] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:41:12 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:41:12.193989 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5125a3-b8ce-4e64-bdbc-826aead6fab9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:12.206522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5125a3-b8ce-4e64-bdbc-826aead6fab9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:12.263321 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:12.264067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:12.264425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:12.264724 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:12.265438 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:12.267565 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:12.376876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1365/2686] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:41:12 2022] POST /identity/v3/users => generated 309 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:41:12.382151 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:12.393325 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee853-9365-4505-82e4-2c88004c657c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:12.398013 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:12.398687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:12.398975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:12.399334 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:12.400149 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:12.401780 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:12.412861 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1322/2687] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:12.425381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:12.436353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c69f6f-e00c-4ff6-8454-0d3315a3d15a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:12.441316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:12.442290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:12.442508 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:12.442937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] PATH_INFO: `/v3/projects/7249704311814e8a86b405bd91e8bf8f/users/f260910a85544c52b3cffb73877957b6/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:12.459088 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7249704311814e8a86b405bd91e8bf8f, user_id=f260910a85544c52b3cffb73877957b6, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:12.461998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:12.572925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1366/2688] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:12 2022] PUT /identity/v3/projects/7249704311814e8a86b405bd91e8bf8f/users/f260910a85544c52b3cffb73877957b6/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:12.576981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:12.587407 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac676-3b9d-44d0-accc-6df453ded197 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:12.644788 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ae332-7784-426f-bddb-048a138dffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:12.645399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae332-7784-426f-bddb-048a138dffb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:12.645688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae332-7784-426f-bddb-048a138dffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:12.645973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae332-7784-426f-bddb-048a138dffb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:12.646714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ae332-7784-426f-bddb-048a138dffb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:12.648345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ae332-7784-426f-bddb-048a138dffb3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:12.658610 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1323/2689] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:12.663869 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:12.675782 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412febb0-8503-4f74-a0a0-7fd4b6ec58c8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:12.681500 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:12.682413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:12.682695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:12.682982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] PATH_INFO: `/v3/projects/7249704311814e8a86b405bd91e8bf8f/users/f260910a85544c52b3cffb73877957b6/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:12.685213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7249704311814e8a86b405bd91e8bf8f, user_id=f260910a85544c52b3cffb73877957b6, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:12.690435 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:12.699393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1367/2690] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:12 2022] PUT /identity/v3/projects/7249704311814e8a86b405bd91e8bf8f/users/f260910a85544c52b3cffb73877957b6/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:14.031632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:14.032197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:14.032197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:14.063354 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] MFA Rules not processed for user `f260910a85544c52b3cffb73877957b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:14.064727 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:14.137285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1324/2691] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:15.627296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:15.695525 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30105f-3f91-48e7-a89f-573976411087 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:15.701030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:15.701911 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:15.702192 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:15.702542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] PATH_INFO: `/v3/users/c31b29b0e5794f8183ffdd8552d3ecac` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:15.703768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31b29b0e5794f8183ffdd8552d3ecac)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:15.706003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:16.104361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31b29b0e5794f8183ffdd8552d3ecac'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.105137 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31b29b0e5794f8183ffdd8552d3ecac'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.193666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31b29b0e5794f8183ffdd8552d3ecac'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.203039 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31b29b0e5794f8183ffdd8552d3ecac'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.203899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31b29b0e5794f8183ffdd8552d3ecac'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.228319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1368/2692] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:41:15 2022] DELETE /identity/v3/users/c31b29b0e5794f8183ffdd8552d3ecac => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:16.408605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:16.410243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:16.428809 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35bf9a-acab-4250-b890-fdd3fe07397e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:16.483661 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:16.484735 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:16.485512 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:16.485800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:16.485992 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:16.486105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] PATH_INFO: `/v3/users/d862997fd89f498c9266548f689ca82d` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:16.487296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d862997fd89f498c9266548f689ca82d)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:16.489263 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:16.500730 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7b9ac-16db-4470-9c3d-10ac25302976 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:16.505986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:16.506898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:16.507132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:16.507420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] PATH_INFO: `/v3/projects/793a2afc56d84e3ea3a2d286445f4c8e` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:16.508813 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] RBAC: Authorizing `identity:delete_project(project_id=793a2afc56d84e3ea3a2d286445f4c8e)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:16.512841 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:16.759198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793a2afc56d84e3ea3a2d286445f4c8e', 'request_id': 'req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.759888 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd862997fd89f498c9266548f689ca82d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.766777 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd862997fd89f498c9266548f689ca82d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.767771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793a2afc56d84e3ea3a2d286445f4c8e', 'request_id': 'req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.954796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793a2afc56d84e3ea3a2d286445f4c8e', 'request_id': 'req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.966080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] The token cache is being invalidate because project 793a2afc56d84e3ea3a2d286445f4c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:16.966363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.966982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:16.968567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1369/2693] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:41:16 2022] DELETE /identity/v3/projects/793a2afc56d84e3ea3a2d286445f4c8e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:16.972403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:16.973685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:17.028495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd862997fd89f498c9266548f689ca82d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.038022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe1df-dfa3-4878-939d-a20c2c9a578f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:17.044065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:17.044508 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd862997fd89f498c9266548f689ca82d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.044988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:17.045254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd862997fd89f498c9266548f689ca82d'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.045401 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:17.045534 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] PATH_INFO: `/v3/users/f260910a85544c52b3cffb73877957b6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:17.047239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f260910a85544c52b3cffb73877957b6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:17.049281 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:17.052005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1325/2694] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:41:16 2022] DELETE /identity/v3/users/d862997fd89f498c9266548f689ca82d => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:17.215549 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f260910a85544c52b3cffb73877957b6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.216257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f260910a85544c52b3cffb73877957b6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.274858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f260910a85544c52b3cffb73877957b6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.283097 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f260910a85544c52b3cffb73877957b6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.283784 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f260910a85544c52b3cffb73877957b6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.301026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:17.303165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:17.307704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1370/2695] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:41:16 2022] DELETE /identity/v3/users/f260910a85544c52b3cffb73877957b6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:17.385820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd795-8819-41ba-a90b-c2993040341f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:17.449138 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:17.450770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:17.451124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:17.451666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] PATH_INFO: `/v3/projects/e680c24b57824d6686b37f86fd1ff881` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:17.453280 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e680c24b57824d6686b37f86fd1ff881)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:17.455301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:17.608442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e680c24b57824d6686b37f86fd1ff881', 'request_id': 'req-39a142b0-c410-4181-b59a-a65a071a88a6'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.615386 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e680c24b57824d6686b37f86fd1ff881', 'request_id': 'req-39a142b0-c410-4181-b59a-a65a071a88a6'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.642221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:17.643758 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:17.661284 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dccf35-d6a4-4b6e-8398-a7829f607570 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:17.690562 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e680c24b57824d6686b37f86fd1ff881', 'request_id': 'req-39a142b0-c410-4181-b59a-a65a071a88a6'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.702706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] The token cache is being invalidate because project e680c24b57824d6686b37f86fd1ff881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:17.703086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.703854 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-39a142b0-c410-4181-b59a-a65a071a88a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.705488 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1326/2696] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:41:17 2022] DELETE /identity/v3/projects/e680c24b57824d6686b37f86fd1ff881 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:17.711750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05bc9-380f-4624-8537-382a2ca2cb0d None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:17.712111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05bc9-380f-4624-8537-382a2ca2cb0d None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:17.712413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05bc9-380f-4624-8537-382a2ca2cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:17.725902 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:17.726975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:17.727205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:17.727498 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] PATH_INFO: `/v3/projects/7249704311814e8a86b405bd91e8bf8f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:17.728860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7249704311814e8a86b405bd91e8bf8f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:17.731552 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:17.731810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6fd05bc9-380f-4624-8537-382a2ca2cb0d None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:17.733064 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6fd05bc9-380f-4624-8537-382a2ca2cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:17.741753 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1327/2697] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:17.750393 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eea94-b090-43b6-94ab-d1c1b4d8288f None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:17.754371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eea94-b090-43b6-94ab-d1c1b4d8288f None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:17.754371 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eea94-b090-43b6-94ab-d1c1b4d8288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:17.771001 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-565eea94-b090-43b6-94ab-d1c1b4d8288f None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:17.772248 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-565eea94-b090-43b6-94ab-d1c1b4d8288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:17.780458 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1328/2698] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:17.787945 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eea94-b090-43b6-94ab-d1c1b4d8288f None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:17.801665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eea94-b090-43b6-94ab-d1c1b4d8288f None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:17.807911 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:17.808600 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:17.808889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:17.809176 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:17.810075 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:41:17.810615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:17.812635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:17.828538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1329/2699] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:41:17.833406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:17.843683 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ddb74-cf1b-4443-851e-c14cc3fe373f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:17.848668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:17.852135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:17.852135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:17.852135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:17.852135 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:17.852676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:17.911251 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7249704311814e8a86b405bd91e8bf8f', 'request_id': 'req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.918366 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7249704311814e8a86b405bd91e8bf8f', 'request_id': 'req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:17.976107 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1330/2700] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:41:17 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:41:17.978282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:17.989224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7249704311814e8a86b405bd91e8bf8f', 'request_id': 'req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.001089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] The token cache is being invalidate because project 7249704311814e8a86b405bd91e8bf8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:18.001373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.002036 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3bf1ce2b-59f0-4746-9295-8d1bea039e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.003720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1371/2701] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:41:17 2022] DELETE /identity/v3/projects/7249704311814e8a86b405bd91e8bf8f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:18.008643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce42d-16ec-4009-89c4-65e0c641c99c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.008932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce42d-16ec-4009-89c4-65e0c641c99c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.009759 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce42d-16ec-4009-89c4-65e0c641c99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.027967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5ffce42d-16ec-4009-89c4-65e0c641c99c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:18.029221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5ffce42d-16ec-4009-89c4-65e0c641c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.051835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933f55-fea9-423b-a7a4-cfdbbcb02e9f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.056559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.057917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.058195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.058623 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.059319 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.061271 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.095781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1372/2702] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:18.105581 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c79cff-878c-4ab2-9196-0931b4eb7f0a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.105867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c79cff-878c-4ab2-9196-0931b4eb7f0a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.106143 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c79cff-878c-4ab2-9196-0931b4eb7f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.126755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-89c79cff-878c-4ab2-9196-0931b4eb7f0a None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:18.128011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-89c79cff-878c-4ab2-9196-0931b4eb7f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.136151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1373/2703] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:18.140327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c79cff-878c-4ab2-9196-0931b4eb7f0a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.151208 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c79cff-878c-4ab2-9196-0931b4eb7f0a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.158783 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.159987 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.160470 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.160942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.163595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:41:18.163595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.165855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.171403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1331/2704] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:41:17 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:41:18.172899 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.175622 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.186100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1374/2705] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:41:18.192548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66705-7613-4d86-a149-573e7b1f2d97 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.193339 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.197846 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.198532 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.198821 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.199104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.199884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.201538 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.203874 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4396ee-8093-46e5-af11-73a907d66825 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.209100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.209765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.210045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.210317 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.211010 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.213620 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1332/2706] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:41:18.213843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.217141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.227546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f010f-f98e-462c-9e6a-4dce947d8ba7 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.233442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.234123 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.235044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.235327 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.236101 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.237713 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.248969 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1333/2707] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:41:18.253146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.263529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f172-34b3-4170-b7e9-074effc72cda admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.268550 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159a073-10ba-4830-9857-c3d8356532f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.272457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159a073-10ba-4830-9857-c3d8356532f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.272457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159a073-10ba-4830-9857-c3d8356532f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.272457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159a073-10ba-4830-9857-c3d8356532f0 admin admin] PATH_INFO: `/v3/projects/1f8088c9f2ed4a259f79827002e54975/users/1472fb57fb5848d6bd5c85852ac2eae9/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.286399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159a073-10ba-4830-9857-c3d8356532f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8088c9f2ed4a259f79827002e54975, user_id=1472fb57fb5848d6bd5c85852ac2eae9, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.289108 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159a073-10ba-4830-9857-c3d8356532f0 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.302474 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1375/2708] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:41:18.307286 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.384111 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1334/2709] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:18 2022] PUT /identity/v3/projects/1f8088c9f2ed4a259f79827002e54975/users/1472fb57fb5848d6bd5c85852ac2eae9/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:18.387540 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b40ebf-3eec-4f8a-9159-e1ba1f213acf admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.391193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.391743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.392098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.414196 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:18.415642 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.454729 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.455410 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.455994 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.456275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.456968 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.458885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.482236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1335/2710] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:18.492637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.495020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.552521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1376/2711] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:41:18.554011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.564225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef6fce-cb52-4806-95b8-c91ae6109d36 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.569030 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.569704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.570025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.570301 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.571028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.571507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1555-1777-44ae-bab1-59f862ba940c None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.572693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.577617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.578645 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.578938 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.579219 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.583863 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1377/2712] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:41:18.590313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.590497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.591853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.601051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb04a9b-1d76-43ac-b275-3e4f81097dca admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.602432 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1336/2713] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:41:18.607056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ce8e1-5b01-4f2c-968e-fa93f64f320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.607756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ce8e1-5b01-4f2c-968e-fa93f64f320b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.608040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ce8e1-5b01-4f2c-968e-fa93f64f320b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.608350 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ce8e1-5b01-4f2c-968e-fa93f64f320b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.612120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ce8e1-5b01-4f2c-968e-fa93f64f320b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.612120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ce8e1-5b01-4f2c-968e-fa93f64f320b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.626179 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1378/2714] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:18.630419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.640907 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16075-604f-4249-9fe3-a59427ac0c24 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.645986 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.646882 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.647168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.647452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] PATH_INFO: `/v3/projects/f821ca5f17884d7dbb6d9e278e9dd6e1/users/18035f1dd1284c2cb07538a11ae8dc32/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.665003 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f821ca5f17884d7dbb6d9e278e9dd6e1, user_id=18035f1dd1284c2cb07538a11ae8dc32, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.667741 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.764749 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1337/2715] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:18 2022] PUT /identity/v3/projects/f821ca5f17884d7dbb6d9e278e9dd6e1/users/18035f1dd1284c2cb07538a11ae8dc32/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:18.777986 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd01b5-5c7e-4d52-95b4-b295e7f16984 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.778488 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd01b5-5c7e-4d52-95b4-b295e7f16984 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.778983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd01b5-5c7e-4d52-95b4-b295e7f16984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.828261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e8cd01b5-5c7e-4d52-95b4-b295e7f16984 None None] MFA Rules not processed for user `18035f1dd1284c2cb07538a11ae8dc32`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:18.830319 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e8cd01b5-5c7e-4d52-95b4-b295e7f16984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.898436 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1379/2716] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:18.904559 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.970628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bc291-f182-4f29-a43e-01fe9650a786 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.976098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.976797 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.977078 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.977361 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.978083 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.980145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.088497 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1338/2717] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:41:19.092461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd01b5-5c7e-4d52-95b4-b295e7f16984 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:19.103901 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd01b5-5c7e-4d52-95b4-b295e7f16984 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:19.178700 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:19.179342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.179662 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.179942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.180666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:19.183165 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.320297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1380/2718] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:41:19 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:41:19.324381 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:19.335179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd3b04-62ea-4c68-8057-fe7968c435aa admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:19.341656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:19.341656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.341656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.341967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.342628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:19.344265 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.356368 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1339/2719] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:19.360440 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:19.374067 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1abe3-552b-4eb8-a53e-99dd0a1946c4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:19.379450 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:19.380461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.380748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.381022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] PATH_INFO: `/v3/projects/89ff156544e04a3886684c923c116e9d/users/9b9ef0023637407790e63fe329574f14/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.399796 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ff156544e04a3886684c923c116e9d, user_id=9b9ef0023637407790e63fe329574f14, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:19.404022 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.510315 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1381/2720] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:19 2022] PUT /identity/v3/projects/89ff156544e04a3886684c923c116e9d/users/9b9ef0023637407790e63fe329574f14/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:19.514276 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:19.526029 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaaebe0-c26e-42fe-a1b8-d2a3790aa19e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:19.586212 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b46a8e-2959-4d98-80d1-d36e7e27eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:19.586894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b46a8e-2959-4d98-80d1-d36e7e27eaca admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.587179 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b46a8e-2959-4d98-80d1-d36e7e27eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.587456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b46a8e-2959-4d98-80d1-d36e7e27eaca admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.588806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b46a8e-2959-4d98-80d1-d36e7e27eaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:19.590416 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b46a8e-2959-4d98-80d1-d36e7e27eaca admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.604906 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1340/2721] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:19.606243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:19.617291 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2915a73-70c0-491b-9e03-e6f85a26051f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:19.622250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:19.623147 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.623430 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.623749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] PATH_INFO: `/v3/projects/89ff156544e04a3886684c923c116e9d/users/9b9ef0023637407790e63fe329574f14/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.625840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ff156544e04a3886684c923c116e9d, user_id=9b9ef0023637407790e63fe329574f14, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:19.628547 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.642458 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1382/2722] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:19 2022] PUT /identity/v3/projects/89ff156544e04a3886684c923c116e9d/users/9b9ef0023637407790e63fe329574f14/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:19.653931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90817de-e037-4aa7-8c72-fcc6e65bdf3a None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.654652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90817de-e037-4aa7-8c72-fcc6e65bdf3a None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.654918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90817de-e037-4aa7-8c72-fcc6e65bdf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.689875 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-a90817de-e037-4aa7-8c72-fcc6e65bdf3a None None] MFA Rules not processed for user `9b9ef0023637407790e63fe329574f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:19.691224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a90817de-e037-4aa7-8c72-fcc6e65bdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:19.769168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1341/2723] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:19.782717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:19.784555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:19.849887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc8eb-e8c2-4741-9403-bb0d4af1ceb8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:19.853686 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876fd0d-8e69-479d-90b7-6802d72b3f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:19.854356 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876fd0d-8e69-479d-90b7-6802d72b3f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.854619 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876fd0d-8e69-479d-90b7-6802d72b3f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.854894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876fd0d-8e69-479d-90b7-6802d72b3f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.865795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876fd0d-8e69-479d-90b7-6802d72b3f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:19.869846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876fd0d-8e69-479d-90b7-6802d72b3f13 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.889173 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1383/2724] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:20.181425 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90817de-e037-4aa7-8c72-fcc6e65bdf3a None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:20.194305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90817de-e037-4aa7-8c72-fcc6e65bdf3a None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:20.198095 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:20.198766 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:20.199065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:20.199328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:20.272894 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:20.276417 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:20.293871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1342/2725] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:41:25.399844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcf149-d6e3-4bd2-b3c6-02f914ca1e2e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:25.401351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcf149-d6e3-4bd2-b3c6-02f914ca1e2e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:25.401641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcf149-d6e3-4bd2-b3c6-02f914ca1e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:25.431895 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-eafcf149-d6e3-4bd2-b3c6-02f914ca1e2e None None] MFA Rules not processed for user `1472fb57fb5848d6bd5c85852ac2eae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:25.433361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-eafcf149-d6e3-4bd2-b3c6-02f914ca1e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:25.509971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1384/2726] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:25.515338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:25.596678 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6a06d-49fb-4331-9536-6a2ce8ee57c9 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:25.606148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:25.606928 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:25.607278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:25.608128 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:25.608833 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:25.610772 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:25.748422 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1343/2727] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:41:25 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:41:25.750977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcf149-d6e3-4bd2-b3c6-02f914ca1e2e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:25.764288 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcf149-d6e3-4bd2-b3c6-02f914ca1e2e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:25.840666 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:25.841212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:25.841821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:25.842113 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:25.843069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:25.847776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:25.957955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1385/2728] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:41:25 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:41:25.962165 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:25.975305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e010-baa1-491f-9dc5-1cde0621298a admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:25.990500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:25.990500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:25.990500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:25.990500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:25.990889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:25.990889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:26.009852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1344/2729] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:26.017287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:26.030324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1c34-894d-4a5f-b163-ac163dd2c2ae admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:26.037187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:26.039063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:26.039461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:26.040161 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] PATH_INFO: `/v3/projects/ebdadd6f430e40659e5ea7397ed44547/users/ccd090f40ffb4d1cbcfd55b59c93319f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:26.063184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdadd6f430e40659e5ea7397ed44547, user_id=ccd090f40ffb4d1cbcfd55b59c93319f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:26.065925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:26.144672 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1386/2730] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:26 2022] PUT /identity/v3/projects/ebdadd6f430e40659e5ea7397ed44547/users/ccd090f40ffb4d1cbcfd55b59c93319f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:26.154442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:26.173436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525acf-3262-48ce-a43a-0a14763f2505 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:26.242964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:26.246114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:26.277080 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:26.277775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:26.278051 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:26.278518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:26.279440 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:26.282585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:26.294252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1345/2731] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:41:26.300524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:26.327388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264a968-cfbb-421c-8ee9-a3dbdbc4020c admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:26.352158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:26.353317 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:26.353818 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:26.354302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] PATH_INFO: `/v3/projects/ebdadd6f430e40659e5ea7397ed44547/users/ccd090f40ffb4d1cbcfd55b59c93319f/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:26.361130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdadd6f430e40659e5ea7397ed44547, user_id=ccd090f40ffb4d1cbcfd55b59c93319f, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:26.369446 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:26.383824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1346/2732] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:41:26 2022] PUT /identity/v3/projects/ebdadd6f430e40659e5ea7397ed44547/users/ccd090f40ffb4d1cbcfd55b59c93319f/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:26.435744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e011-75fa-4dbc-aeb7-673e423cf9fc admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:26.519529 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d0046-8060-4a75-ad97-e9c49a9498bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:26.520378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0046-8060-4a75-ad97-e9c49a9498bb service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:26.520766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0046-8060-4a75-ad97-e9c49a9498bb service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:26.521158 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0046-8060-4a75-ad97-e9c49a9498bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:26.523977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-502d0046-8060-4a75-ad97-e9c49a9498bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:26.538582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d0046-8060-4a75-ad97-e9c49a9498bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:26.540818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d0046-8060-4a75-ad97-e9c49a9498bb service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:26.565259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1387/2733] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:28.468561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:28.470734 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:28.551989 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565d76c-0b27-4246-96ec-08c9f25d3088 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:28.558934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:28.560069 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:28.560522 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:28.560799 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:28.564146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:28.575321 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:28.577047 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:28.587655 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1347/2734] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:33.998886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cbdb-5a18-4460-8f52-394319074868 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:33.998886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cbdb-5a18-4460-8f52-394319074868 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:33.998886 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cbdb-5a18-4460-8f52-394319074868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:34.045551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-42a8cbdb-5a18-4460-8f52-394319074868 None None] MFA Rules not processed for user `ccd090f40ffb4d1cbcfd55b59c93319f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:34.104927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-42a8cbdb-5a18-4460-8f52-394319074868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:34.171925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1388/2735] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:34.206289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:34.206289 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:34.313201 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd239-a123-4264-a6dd-0a3c803e330d service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:34.317254 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc69b41ea4d6456f9532cee386265e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:34.317947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:34.318230 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:34.318507 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:34.379724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:34.381189 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:34.390826 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1348/2736] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:34.699388 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049677c-eaff-41ee-8857-a50dd92cd19a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:34.699737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049677c-eaff-41ee-8857-a50dd92cd19a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:34.699981 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049677c-eaff-41ee-8857-a50dd92cd19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:34.724026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3049677c-eaff-41ee-8857-a50dd92cd19a None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:34.724026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3049677c-eaff-41ee-8857-a50dd92cd19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:34.805652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1389/2737] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:41:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:34.980635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:34.982602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:35.088599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4265-3a9e-428f-8b91-09fdd60965c5 service glance] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:35.094602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a312c-10cc-4dad-b30e-80c1b59867c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:35.095285 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a312c-10cc-4dad-b30e-80c1b59867c6 service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:35.095715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a312c-10cc-4dad-b30e-80c1b59867c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:35.095918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a312c-10cc-4dad-b30e-80c1b59867c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:35.106231 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a312c-10cc-4dad-b30e-80c1b59867c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:35.107981 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a312c-10cc-4dad-b30e-80c1b59867c6 service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:35.118065 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1349/2738] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:41:45.054790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049677c-eaff-41ee-8857-a50dd92cd19a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:45.068977 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049677c-eaff-41ee-8857-a50dd92cd19a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:45.073040 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:45.073890 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:45.074184 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:45.074647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:45.076702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:45.176140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:45.177764 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:45.193762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1390/2739] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:41:48.090161 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:48.096086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:48.096086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:48.109377 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] MFA Rules not processed for user `1472fb57fb5848d6bd5c85852ac2eae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:48.111025 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:48.118738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1350/2740] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:48.413279 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:48.423128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ecb8a-fc2d-42d1-9e95-6e7903431150 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:48.426867 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:48.427609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:48.427953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:48.428287 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:48.430139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:48.441903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:48.443642 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:48.453880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1391/2741] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:48.968641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:48.970442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:49.059220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537e79b-df74-44a4-90d8-26a5ca0d6edb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:49.065739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:49.066431 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:49.067960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:49.067960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:49.069089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:49.083296 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:49.085529 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:49.117341 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1351/2742] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:54.003617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:54.004735 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:54.022690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f243-1104-4b7c-88db-133db1321b0c service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:54.027375 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:54.028313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:54.028599 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:54.028880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] PATH_INFO: `/v3/users/2d89e1e4baa44cc0ad28c8dcaef5af76` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:54.030336 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d89e1e4baa44cc0ad28c8dcaef5af76)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:54.032323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:54.273403 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d89e1e4baa44cc0ad28c8dcaef5af76'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:54.274766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d89e1e4baa44cc0ad28c8dcaef5af76'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:54.351831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d89e1e4baa44cc0ad28c8dcaef5af76'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:54.360876 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d89e1e4baa44cc0ad28c8dcaef5af76'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:54.361680 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d89e1e4baa44cc0ad28c8dcaef5af76'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:54.380502 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1392/2743] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:41:54 2022] DELETE /identity/v3/users/2d89e1e4baa44cc0ad28c8dcaef5af76 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:54.734190 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:54.755269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609e7b-d784-4834-b3b6-aac64f4fdb30 service placement] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:54.822589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:54.823496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:54.823792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:54.824076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] PATH_INFO: `/v3/projects/fbee1a37bbff489e85a9d366fb34e8d4` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:54.825310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbee1a37bbff489e85a9d366fb34e8d4)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:54.827535 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:55.003872 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbee1a37bbff489e85a9d366fb34e8d4', 'request_id': 'req-d98ef058-9a11-40f4-88f0-114aa424bd99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.011750 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbee1a37bbff489e85a9d366fb34e8d4', 'request_id': 'req-d98ef058-9a11-40f4-88f0-114aa424bd99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.093091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbee1a37bbff489e85a9d366fb34e8d4', 'request_id': 'req-d98ef058-9a11-40f4-88f0-114aa424bd99'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.108122 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] The token cache is being invalidate because project fbee1a37bbff489e85a9d366fb34e8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:55.108637 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.109676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.112183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1352/2744] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:41:54 2022] DELETE /identity/v3/projects/fbee1a37bbff489e85a9d366fb34e8d4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:55.116923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:55.119699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:55.137110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701113f4-d182-4970-a175-7f54a5f7d0b8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:55.214601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:55.215765 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:55.215979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:55.216153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] PATH_INFO: `/v3/users/78e0b97ac10941b7a5cd721147d68232` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:55.217468 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e0b97ac10941b7a5cd721147d68232)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:55.223917 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:55.489378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e0b97ac10941b7a5cd721147d68232'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.490493 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e0b97ac10941b7a5cd721147d68232'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.571320 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e0b97ac10941b7a5cd721147d68232'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.588597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e0b97ac10941b7a5cd721147d68232'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.589732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f39176e-11a9-4693-8273-1e38ded6638d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e0b97ac10941b7a5cd721147d68232'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:55.621548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1393/2745] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:41:55 2022] DELETE /identity/v3/users/78e0b97ac10941b7a5cd721147d68232 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:55.963394 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:55.964825 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:55.983152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef058-9a11-40f4-88f0-114aa424bd99 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:56.025692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:56.025692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:56.025692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:56.048182 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:56.050663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:56.074246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:56.075163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:56.075506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:56.075801 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] PATH_INFO: `/v3/projects/07d596097386437da37801c01f06eb21` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:56.080454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d596097386437da37801c01f06eb21)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:56.082738 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:56.133059 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1394/2746] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:41:56.152552 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:56.154484 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:56.233201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d20a88-b5e6-46df-b475-464a4c580918 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:56.241831 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:56.242998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:56.243668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:56.244313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:56.257217 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:56.257472 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d596097386437da37801c01f06eb21', 'request_id': 'req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:56.260663 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:56.266773 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d596097386437da37801c01f06eb21', 'request_id': 'req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:56.274459 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1395/2747] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:41:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:41:56.375052 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d596097386437da37801c01f06eb21', 'request_id': 'req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:56.387705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] The token cache is being invalidate because project 07d596097386437da37801c01f06eb21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:56.388084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:56.388856 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:56.390663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1353/2748] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:41:55 2022] DELETE /identity/v3/projects/07d596097386437da37801c01f06eb21 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:13.219682 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:13.221163 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.263688 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:13.266086 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.304985 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b841fd6-91bd-45ba-8c1f-350fd56c960a service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:13.375266 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:13.376211 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.376494 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.376774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] PATH_INFO: `/v3/users/18035f1dd1284c2cb07538a11ae8dc32` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.377983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18035f1dd1284c2cb07538a11ae8dc32)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.379954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.386328 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7fe2f-7fc0-421e-96e4-2914bac39ce4 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:13.392070 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea06d9-c2c2-46bb-bfe8-caee955531bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:13.392724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea06d9-c2c2-46bb-bfe8-caee955531bb service nova] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.393006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea06d9-c2c2-46bb-bfe8-caee955531bb service nova] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.393288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea06d9-c2c2-46bb-bfe8-caee955531bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.395084 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-08ea06d9-c2c2-46bb-bfe8-caee955531bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.407567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea06d9-c2c2-46bb-bfe8-caee955531bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.409316 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea06d9-c2c2-46bb-bfe8-caee955531bb service nova] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.420718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1354/2749] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:13.517189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18035f1dd1284c2cb07538a11ae8dc32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.517872 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18035f1dd1284c2cb07538a11ae8dc32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.594227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18035f1dd1284c2cb07538a11ae8dc32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.603100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18035f1dd1284c2cb07538a11ae8dc32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.603855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18035f1dd1284c2cb07538a11ae8dc32'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.622802 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1396/2750] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:13 2022] DELETE /identity/v3/users/18035f1dd1284c2cb07538a11ae8dc32 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:13.627338 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.627668 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.627958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.654210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:13.655419 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.717960 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1355/2751] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:13.728633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:13.730139 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.811392 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bab84-8f47-405c-9474-6b6b6212b703 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:13.815068 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:13.815763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.816048 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.816324 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.825522 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.826945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.837095 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1397/2752] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:14.237843 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:14.239385 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:14.255188 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1590-7bac-468f-88b0-09bd94898ebc None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:14.261580 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:14.263889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:14.263889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:14.263889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] PATH_INFO: `/v3/projects/f821ca5f17884d7dbb6d9e278e9dd6e1` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:14.264671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f821ca5f17884d7dbb6d9e278e9dd6e1)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:14.266581 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:14.390857 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f821ca5f17884d7dbb6d9e278e9dd6e1', 'request_id': 'req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.396871 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f821ca5f17884d7dbb6d9e278e9dd6e1', 'request_id': 'req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.464994 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f821ca5f17884d7dbb6d9e278e9dd6e1', 'request_id': 'req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.475635 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] The token cache is being invalidate because project f821ca5f17884d7dbb6d9e278e9dd6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:14.475922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.476665 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.478207 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1356/2753] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:14 2022] DELETE /identity/v3/projects/f821ca5f17884d7dbb6d9e278e9dd6e1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:14.482205 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:14.492564 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510c663-5b23-4814-a3bf-d4337586ea5a service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:14.547425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:14.548437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:14.548719 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:14.549011 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] PATH_INFO: `/v3/users/9b9ef0023637407790e63fe329574f14` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:14.550180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9ef0023637407790e63fe329574f14)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:14.552204 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:14.763451 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9ef0023637407790e63fe329574f14'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.764423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9ef0023637407790e63fe329574f14'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.822376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9ef0023637407790e63fe329574f14'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.830259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9ef0023637407790e63fe329574f14'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.832259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5ac73e4b-d802-4a90-9c12-75f139679dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9ef0023637407790e63fe329574f14'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.848235 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1398/2754] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:14 2022] DELETE /identity/v3/users/9b9ef0023637407790e63fe329574f14 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:15.332845 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.334294 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:15.347761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1efed-8036-4ab1-beff-5a6e7b28f7ff admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.406079 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.406959 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.407275 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.407598 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] PATH_INFO: `/v3/projects/89ff156544e04a3886684c923c116e9d` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.408844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ff156544e04a3886684c923c116e9d)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.410775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.559184 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ff156544e04a3886684c923c116e9d', 'request_id': 'req-78894f35-4bc9-448f-96fd-f502713cad07'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:15.565206 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ff156544e04a3886684c923c116e9d', 'request_id': 'req-78894f35-4bc9-448f-96fd-f502713cad07'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:15.625775 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ff156544e04a3886684c923c116e9d', 'request_id': 'req-78894f35-4bc9-448f-96fd-f502713cad07'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:15.637015 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] The token cache is being invalidate because project 89ff156544e04a3886684c923c116e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:15.637305 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:15.637972 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-78894f35-4bc9-448f-96fd-f502713cad07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:15.639594 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1357/2755] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:15 2022] DELETE /identity/v3/projects/89ff156544e04a3886684c923c116e9d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:15.645058 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a2ed-e921-4523-b004-fa849e231eba None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.645608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a2ed-e921-4523-b004-fa849e231eba None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.645717 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a2ed-e921-4523-b004-fa849e231eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.689259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3ed8a2ed-e921-4523-b004-fa849e231eba None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:15.690632 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3ed8a2ed-e921-4523-b004-fa849e231eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:15.754352 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1399/2756] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:15.763790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa56a-6dbd-46af-958a-face034547f6 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.768648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa56a-6dbd-46af-958a-face034547f6 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.768648 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa56a-6dbd-46af-958a-face034547f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.782790 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f77aa56a-6dbd-46af-958a-face034547f6 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:15.784028 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f77aa56a-6dbd-46af-958a-face034547f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:15.792883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1358/2757] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:15.797144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a2ed-e921-4523-b004-fa849e231eba None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.807722 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a2ed-e921-4523-b004-fa849e231eba None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.812275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.812930 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.813209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.813563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.814309 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:15.814611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.816250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.829420 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1400/2758] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:15.833410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa56a-6dbd-46af-958a-face034547f6 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.843852 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa56a-6dbd-46af-958a-face034547f6 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.848679 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.849358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.849643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.849923 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.850630 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.853085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.959855 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1359/2759] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:42:15 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:15.961709 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.973213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f6dc5-859b-449f-af56-f248d004217b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.034767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.035454 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.035899 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.036092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.036747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.038693 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:16.137193 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1401/2760] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:42:15 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:16.141195 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.154342 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2984e8-e394-4540-98a7-cb73cd5c7175 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.159356 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.160067 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.160359 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.160751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.161496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.163100 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:16.175162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1360/2761] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:16.179360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.189951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec56440-6035-47c8-a9ad-f05a63ffca0f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.194952 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2fd04-878b-4f68-b33e-2b8a86b29b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.195643 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2fd04-878b-4f68-b33e-2b8a86b29b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.195927 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2fd04-878b-4f68-b33e-2b8a86b29b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.196202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2fd04-878b-4f68-b33e-2b8a86b29b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.197063 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2fd04-878b-4f68-b33e-2b8a86b29b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.198732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2fd04-878b-4f68-b33e-2b8a86b29b20 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:16.209824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1402/2762] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:16.214549 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.224511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a62e-bc21-49db-8e43-bf1c6381c6d4 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.230146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.231071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.231511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.231805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] PATH_INFO: `/v3/projects/dd6ad9fc8456405c9a2f1f4c700e53e1/users/be3160c8b69b440491481b6c50e2c1c2/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.246792 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6ad9fc8456405c9a2f1f4c700e53e1, user_id=be3160c8b69b440491481b6c50e2c1c2, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.249496 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:16.319973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1361/2763] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:16 2022] PUT /identity/v3/projects/dd6ad9fc8456405c9a2f1f4c700e53e1/users/be3160c8b69b440491481b6c50e2c1c2/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:16.330767 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5455-9b85-4c07-b483-2d9e3571eadc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.331071 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5455-9b85-4c07-b483-2d9e3571eadc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.331357 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5455-9b85-4c07-b483-2d9e3571eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.360092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e62b5455-9b85-4c07-b483-2d9e3571eadc None None] MFA Rules not processed for user `be3160c8b69b440491481b6c50e2c1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:16.361369 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e62b5455-9b85-4c07-b483-2d9e3571eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:16.440224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1403/2764] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:16.443264 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.510820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1f12-efc6-4192-b292-5c4bd7b768a9 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.515712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.516390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.516667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.516957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.517657 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.519858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:16.665958 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1362/2765] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:42:16 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:16.672485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b5455-9b85-4c07-b483-2d9e3571eadc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.687503 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b5455-9b85-4c07-b483-2d9e3571eadc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.762260 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.762966 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.763353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.763551 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.764225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.766218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:16.896820 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1404/2766] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:42:16 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:16.901085 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.911308 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceb50a-baf0-4ac8-973f-371edb337e3f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.916363 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.917059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.918350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.918350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.918350 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.920185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:16.931978 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1363/2767] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:16.936331 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.947706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ebca-1d99-4864-b4f6-3555b39fc508 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:16.952714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:16.953604 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:16.954148 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:16.954426 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] PATH_INFO: `/v3/projects/629df967d3c247f8afd6bd01a5668f81/users/60f902af3d924642851304bff3f0e0e2/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:16.970535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629df967d3c247f8afd6bd01a5668f81, user_id=60f902af3d924642851304bff3f0e0e2, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:16.973253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.083014 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1405/2768] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:16 2022] PUT /identity/v3/projects/629df967d3c247f8afd6bd01a5668f81/users/60f902af3d924642851304bff3f0e0e2/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:17.087298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.098043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c1cf9-7775-441d-b8cc-af0966e620fc admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.171023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9357ce-0145-4a6f-8094-572728db7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.171023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9357ce-0145-4a6f-8094-572728db7cda admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.171023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9357ce-0145-4a6f-8094-572728db7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.171023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9357ce-0145-4a6f-8094-572728db7cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.173045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9357ce-0145-4a6f-8094-572728db7cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.173045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9357ce-0145-4a6f-8094-572728db7cda admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.180383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1364/2769] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:17.184738 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.196227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea744fd-8fd5-4004-8675-4cf26b70e358 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.201704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.203123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.203613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.204325 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] PATH_INFO: `/v3/projects/629df967d3c247f8afd6bd01a5668f81/users/60f902af3d924642851304bff3f0e0e2/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.207423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629df967d3c247f8afd6bd01a5668f81, user_id=60f902af3d924642851304bff3f0e0e2, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.212261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.235825 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1406/2770] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:17 2022] PUT /identity/v3/projects/629df967d3c247f8afd6bd01a5668f81/users/60f902af3d924642851304bff3f0e0e2/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:17.240403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02b94-2113-4380-b3a2-7bedfd1a3242 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.240403 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02b94-2113-4380-b3a2-7bedfd1a3242 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.240830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02b94-2113-4380-b3a2-7bedfd1a3242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.269510 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-38d02b94-2113-4380-b3a2-7bedfd1a3242 None None] MFA Rules not processed for user `60f902af3d924642851304bff3f0e0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:17.270744 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-38d02b94-2113-4380-b3a2-7bedfd1a3242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.344211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1365/2771] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:17.357593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.359818 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.422674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d7c5-228b-43df-ae9c-af46a1e850a9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.426641 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f6568-c085-4ece-842d-e56ff15710c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.427335 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6568-c085-4ece-842d-e56ff15710c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.427651 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6568-c085-4ece-842d-e56ff15710c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.427925 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6568-c085-4ece-842d-e56ff15710c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.438698 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f6568-c085-4ece-842d-e56ff15710c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.440212 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f6568-c085-4ece-842d-e56ff15710c6 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.451571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1407/2772] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:18.598900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d02b94-2113-4380-b3a2-7bedfd1a3242 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:18.665621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d02b94-2113-4380-b3a2-7bedfd1a3242 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:18.670257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:18.671120 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:18.671400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:18.671714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] PATH_INFO: `/v3/users/be3160c8b69b440491481b6c50e2c1c2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:18.672889 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3160c8b69b440491481b6c50e2c1c2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:18.674867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:18.884782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3160c8b69b440491481b6c50e2c1c2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.891739 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3160c8b69b440491481b6c50e2c1c2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.979410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3160c8b69b440491481b6c50e2c1c2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.992718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3160c8b69b440491481b6c50e2c1c2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.993441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3160c8b69b440491481b6c50e2c1c2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:19.002774 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1366/2773] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:18 2022] DELETE /identity/v3/users/be3160c8b69b440491481b6c50e2c1c2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:19.007696 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:19.008370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:19.008370 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:19.026948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:19.028209 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:19.090247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1408/2774] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:19.100246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:19.102221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:19.159081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fcc3b-1788-4d6f-81bc-efafb6a4a8c6 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:19.162819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:19.163514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:19.166429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:19.166705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:19.178464 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:19.180036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:19.190990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1367/2775] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:19.626571 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:19.632993 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:19.646945 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db734058-9890-4177-a4e3-8fcaa33e8df4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:19.652913 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:19.653808 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:19.654678 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:19.654959 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] PATH_INFO: `/v3/projects/dd6ad9fc8456405c9a2f1f4c700e53e1` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:19.656239 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6ad9fc8456405c9a2f1f4c700e53e1)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:19.658167 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:19.797703 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6ad9fc8456405c9a2f1f4c700e53e1', 'request_id': 'req-4fde8b82-5e8a-4439-b690-5b4187b4d183'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:19.803864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6ad9fc8456405c9a2f1f4c700e53e1', 'request_id': 'req-4fde8b82-5e8a-4439-b690-5b4187b4d183'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:19.922563 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6ad9fc8456405c9a2f1f4c700e53e1', 'request_id': 'req-4fde8b82-5e8a-4439-b690-5b4187b4d183'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:19.934122 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] The token cache is being invalidate because project dd6ad9fc8456405c9a2f1f4c700e53e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:19.934413 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:19.935073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:19.936629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1409/2776] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:19 2022] DELETE /identity/v3/projects/dd6ad9fc8456405c9a2f1f4c700e53e1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:19.940599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:19.950850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff237c-4485-4f6e-8bd2-f8ef70eb1150 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.006044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.006930 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.007238 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.008099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] PATH_INFO: `/v3/users/60f902af3d924642851304bff3f0e0e2` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.009314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f902af3d924642851304bff3f0e0e2)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.011252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.319019 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f902af3d924642851304bff3f0e0e2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:20.325712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f902af3d924642851304bff3f0e0e2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:20.431173 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f902af3d924642851304bff3f0e0e2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:20.443597 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f902af3d924642851304bff3f0e0e2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:20.444284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0ff0c39a-637b-497f-81af-493f549851aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f902af3d924642851304bff3f0e0e2'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:20.450435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1368/2777] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:19 2022] DELETE /identity/v3/users/60f902af3d924642851304bff3f0e0e2 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:20.895805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:20.898016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:20.912224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde8b82-5e8a-4439-b690-5b4187b4d183 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.974275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.975135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.975409 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.975707 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] PATH_INFO: `/v3/projects/629df967d3c247f8afd6bd01a5668f81` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.976919 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629df967d3c247f8afd6bd01a5668f81)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.978848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.106227 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629df967d3c247f8afd6bd01a5668f81', 'request_id': 'req-e593252b-b1ba-4728-8de3-3d775fba9b96'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.112736 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629df967d3c247f8afd6bd01a5668f81', 'request_id': 'req-e593252b-b1ba-4728-8de3-3d775fba9b96'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.181973 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629df967d3c247f8afd6bd01a5668f81', 'request_id': 'req-e593252b-b1ba-4728-8de3-3d775fba9b96'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.192699 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] The token cache is being invalidate because project 629df967d3c247f8afd6bd01a5668f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:21.192983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.193616 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e593252b-b1ba-4728-8de3-3d775fba9b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.195779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1410/2778] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:20 2022] DELETE /identity/v3/projects/629df967d3c247f8afd6bd01a5668f81 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:21.201081 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65819af-57e8-4001-9014-888c94329db5 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.209689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65819af-57e8-4001-9014-888c94329db5 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.209689 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65819af-57e8-4001-9014-888c94329db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.230026 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-e65819af-57e8-4001-9014-888c94329db5 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.231244 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e65819af-57e8-4001-9014-888c94329db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.289609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1369/2779] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.298439 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8009c30-7b26-4fa5-8de9-b52529145807 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.298836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8009c30-7b26-4fa5-8de9-b52529145807 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.299496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8009c30-7b26-4fa5-8de9-b52529145807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.319050 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e8009c30-7b26-4fa5-8de9-b52529145807 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.320975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e8009c30-7b26-4fa5-8de9-b52529145807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.329252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1411/2780] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.333874 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65819af-57e8-4001-9014-888c94329db5 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.343531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65819af-57e8-4001-9014-888c94329db5 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.348009 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.348656 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.348934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.349210 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.349941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:21.350246 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.351880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.363455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1370/2781] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:21.368626 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8009c30-7b26-4fa5-8de9-b52529145807 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.378233 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8009c30-7b26-4fa5-8de9-b52529145807 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.383708 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.384997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.385312 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.385594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.386283 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.388214 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.529790 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1412/2782] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:21.533917 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.543761 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626110-9b33-404f-955e-6ebe4bea7178 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.600842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.602000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.602284 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.602561 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.603243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.605181 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.708337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1371/2783] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:21.712843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.723845 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5bc50-7f52-4fd3-ac73-4e6b86c1d889 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.729249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.729918 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.730202 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.730497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.731203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.732996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.744559 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1413/2784] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:21.748730 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.759253 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa0e70-35cb-46fd-bb6a-bed01dc1d284 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.764034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced5670-2164-4d1a-b58a-0b564b8d8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.764695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced5670-2164-4d1a-b58a-0b564b8d8b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.764984 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced5670-2164-4d1a-b58a-0b564b8d8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.765262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced5670-2164-4d1a-b58a-0b564b8d8b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.765985 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced5670-2164-4d1a-b58a-0b564b8d8b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.767604 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced5670-2164-4d1a-b58a-0b564b8d8b41 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.777709 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1372/2785] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:21.782225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.792806 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753e7c-aeff-4aa1-8406-ec8980cb1c72 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.797652 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.798530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.798811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.799087 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] PATH_INFO: `/v3/projects/67c9db1117b842a1a3ffc6a5665eadad/users/412030cca9f64816aa82587b374952d5/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.814650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c9db1117b842a1a3ffc6a5665eadad, user_id=412030cca9f64816aa82587b374952d5, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.817393 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.928744 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1414/2786] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:21 2022] PUT /identity/v3/projects/67c9db1117b842a1a3ffc6a5665eadad/users/412030cca9f64816aa82587b374952d5/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:21.939712 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035745b4-a38f-4ef0-b177-fe8ae40f463e None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.940006 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035745b4-a38f-4ef0-b177-fe8ae40f463e None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.940375 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035745b4-a38f-4ef0-b177-fe8ae40f463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.968495 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-035745b4-a38f-4ef0-b177-fe8ae40f463e None None] MFA Rules not processed for user `412030cca9f64816aa82587b374952d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.969704 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-035745b4-a38f-4ef0-b177-fe8ae40f463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:22.040355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1373/2787] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:22.045343 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.106189 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d036e-75cc-42f1-82cf-c0c7364e475b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.110967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.111648 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.111932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.112206 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.112889 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.114793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.195114 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1415/2788] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:42:22 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:22.198950 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035745b4-a38f-4ef0-b177-fe8ae40f463e None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.209728 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035745b4-a38f-4ef0-b177-fe8ae40f463e None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.264763 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.265344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.265627 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.265901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.266721 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.268672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.370886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1374/2789] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:42:22 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:22.374888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.387168 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b4dd-1ef9-4031-9f76-42e004b0adb3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.391943 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.392601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.392892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.393164 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.393875 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.395462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.407023 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1416/2790] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:22.411404 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.421554 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8f66-0e21-479b-b475-7148219aac16 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.426286 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.427162 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.427443 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.427751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] PATH_INFO: `/v3/projects/38462776335d49b4ba4ff25175e241f1/users/71abfd9b59e440c1a1ed680756c1fb6e/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.442835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=38462776335d49b4ba4ff25175e241f1, user_id=71abfd9b59e440c1a1ed680756c1fb6e, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.446043 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.515503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1375/2791] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:22 2022] PUT /identity/v3/projects/38462776335d49b4ba4ff25175e241f1/users/71abfd9b59e440c1a1ed680756c1fb6e/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:22.519681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.533041 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88594de3-8cee-46f3-a210-6a7afdc07a2e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.594329 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e06db-11c2-4e4a-a865-b842cef71de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.595018 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e06db-11c2-4e4a-a865-b842cef71de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.595304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e06db-11c2-4e4a-a865-b842cef71de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.595609 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e06db-11c2-4e4a-a865-b842cef71de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.596363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e06db-11c2-4e4a-a865-b842cef71de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.597956 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e06db-11c2-4e4a-a865-b842cef71de0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.607506 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1417/2792] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:42:22.611752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.622605 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a3cf9-1aa1-401e-a24a-312420d805aa admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.627116 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.628036 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.628314 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.628588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] PATH_INFO: `/v3/projects/38462776335d49b4ba4ff25175e241f1/users/71abfd9b59e440c1a1ed680756c1fb6e/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.630703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38462776335d49b4ba4ff25175e241f1, user_id=71abfd9b59e440c1a1ed680756c1fb6e, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.634257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.644390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1376/2793] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:22 2022] PUT /identity/v3/projects/38462776335d49b4ba4ff25175e241f1/users/71abfd9b59e440c1a1ed680756c1fb6e/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:22.709685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b98c7-4fd9-44c0-a3d2-596a2a65bba7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.710029 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b98c7-4fd9-44c0-a3d2-596a2a65bba7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.711081 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b98c7-4fd9-44c0-a3d2-596a2a65bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.739963 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c18b98c7-4fd9-44c0-a3d2-596a2a65bba7 None None] MFA Rules not processed for user `71abfd9b59e440c1a1ed680756c1fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:22.741396 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c18b98c7-4fd9-44c0-a3d2-596a2a65bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:22.813877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1418/2794] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:22.826278 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.828012 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:22.889589 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e817d-2f80-4bb7-909c-1fa57bb71556 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.893405 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.894062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.894352 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.894632 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.904424 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.905873 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.915602 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1377/2795] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:23.061491 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b98c7-4fd9-44c0-a3d2-596a2a65bba7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:23.072263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b98c7-4fd9-44c0-a3d2-596a2a65bba7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.075861 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c713-e034-4329-b34c-be434dc4b802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:23.076505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c713-e034-4329-b34c-be434dc4b802 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.076788 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c713-e034-4329-b34c-be434dc4b802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.077066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c713-e034-4329-b34c-be434dc4b802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.135915 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83c713-e034-4329-b34c-be434dc4b802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:23.137345 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83c713-e034-4329-b34c-be434dc4b802 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:23.146313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1419/2796] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:23.648145 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:23.713412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b363f-a368-45d1-a872-58c48deb1b64 service cinder] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.718018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:23.718886 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.719171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.719449 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] PATH_INFO: `/v3/users/412030cca9f64816aa82587b374952d5` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.720742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412030cca9f64816aa82587b374952d5)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:23.722672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:23.972742 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412030cca9f64816aa82587b374952d5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:23.979967 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412030cca9f64816aa82587b374952d5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.056949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412030cca9f64816aa82587b374952d5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.070099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412030cca9f64816aa82587b374952d5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.070837 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412030cca9f64816aa82587b374952d5'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.076751 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1378/2797] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:23 2022] DELETE /identity/v3/users/412030cca9f64816aa82587b374952d5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:24.081733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.082276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.082276 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.099650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:24.101371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:24.160361 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1420/2798] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:24.170599 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.172054 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:24.227931 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365b358-c093-4e58-a35a-1dd71d8656c4 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:24.231390 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.232062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.232344 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.232621 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.242492 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.243975 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:24.253867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1379/2799] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:24.646128 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.652035 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:24.661178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27983d82-154e-4cc3-bac7-f4acb8bdd8ed None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:24.666190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.667061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.667346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.667668 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] PATH_INFO: `/v3/projects/67c9db1117b842a1a3ffc6a5665eadad` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.668870 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c9db1117b842a1a3ffc6a5665eadad)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.670763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:24.813748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c9db1117b842a1a3ffc6a5665eadad', 'request_id': 'req-63bf69ae-5ee1-4d2e-943b-583e3e12029d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.820391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c9db1117b842a1a3ffc6a5665eadad', 'request_id': 'req-63bf69ae-5ee1-4d2e-943b-583e3e12029d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.884587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c9db1117b842a1a3ffc6a5665eadad', 'request_id': 'req-63bf69ae-5ee1-4d2e-943b-583e3e12029d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.894988 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] The token cache is being invalidate because project 67c9db1117b842a1a3ffc6a5665eadad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:24.895293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.896516 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.897548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1421/2800] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:24 2022] DELETE /identity/v3/projects/67c9db1117b842a1a3ffc6a5665eadad => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:24.902178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.911662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a88ab-bb73-4397-9063-08c0c0b6f954 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:24.966194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.967547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.967547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.967547 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] PATH_INFO: `/v3/users/71abfd9b59e440c1a1ed680756c1fb6e` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.968776 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71abfd9b59e440c1a1ed680756c1fb6e)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.970820 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:25.138715 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71abfd9b59e440c1a1ed680756c1fb6e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:25.145456 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71abfd9b59e440c1a1ed680756c1fb6e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:25.239221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71abfd9b59e440c1a1ed680756c1fb6e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:25.253082 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71abfd9b59e440c1a1ed680756c1fb6e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:25.254058 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a73e607a-bbd5-43c7-a29c-319cabf9b861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71abfd9b59e440c1a1ed680756c1fb6e'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:25.261282 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1380/2801] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:24 2022] DELETE /identity/v3/users/71abfd9b59e440c1a1ed680756c1fb6e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:25.775760 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:25.777253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:25.792316 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf69ae-5ee1-4d2e-943b-583e3e12029d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:25.854776 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:25.855748 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:25.856025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:25.856308 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] PATH_INFO: `/v3/projects/38462776335d49b4ba4ff25175e241f1` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:25.857497 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38462776335d49b4ba4ff25175e241f1)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:25.859411 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:25.985871 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38462776335d49b4ba4ff25175e241f1', 'request_id': 'req-15d6af69-7e83-4ffe-b9d1-a018154c0668'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:25.992250 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38462776335d49b4ba4ff25175e241f1', 'request_id': 'req-15d6af69-7e83-4ffe-b9d1-a018154c0668'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.079555 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38462776335d49b4ba4ff25175e241f1', 'request_id': 'req-15d6af69-7e83-4ffe-b9d1-a018154c0668'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.092332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] The token cache is being invalidate because project 38462776335d49b4ba4ff25175e241f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:26.092608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.093275 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-15d6af69-7e83-4ffe-b9d1-a018154c0668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.095144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1422/2802] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:25 2022] DELETE /identity/v3/projects/38462776335d49b4ba4ff25175e241f1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:26.100662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105a61b-900a-4a5e-b81f-3231e32baaf4 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.100662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105a61b-900a-4a5e-b81f-3231e32baaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.100662 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105a61b-900a-4a5e-b81f-3231e32baaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.126963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-f105a61b-900a-4a5e-b81f-3231e32baaf4 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:26.128241 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-f105a61b-900a-4a5e-b81f-3231e32baaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.193335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1381/2803] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:26.202485 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126fb29-49e7-4842-9341-fa391068e353 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.202772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126fb29-49e7-4842-9341-fa391068e353 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.203342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126fb29-49e7-4842-9341-fa391068e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.221888 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0126fb29-49e7-4842-9341-fa391068e353 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:26.223080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0126fb29-49e7-4842-9341-fa391068e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.231181 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1423/2804] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:26.236527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105a61b-900a-4a5e-b81f-3231e32baaf4 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.248129 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105a61b-900a-4a5e-b81f-3231e32baaf4 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.252681 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.253335 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.253617 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.253893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] PATH_INFO: `/v3/domains` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.254622 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:26.254927 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.256576 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.269185 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1382/2805] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:26.274203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126fb29-49e7-4842-9341-fa391068e353 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.283653 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126fb29-49e7-4842-9341-fa391068e353 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.288431 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.293349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.293349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.293349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.293349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.293349 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.426621 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1424/2806] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:42:26 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:26.431345 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.443819 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9546f-6c35-41b0-b237-b6ce7ba0a971 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.505229 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.505805 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.506098 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.506373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] PATH_INFO: `/v3/users` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.507643 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.509616 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.628358 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1383/2807] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:42:26 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:26.634674 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.645065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161772-7010-4ae1-8a1b-c2a09e1f0de2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.650045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.650715 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.651004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.651282 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.652066 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.653681 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.665855 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1425/2808] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:26.670224 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.682900 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a24023-b41a-4f9f-9580-d81a392b9f33 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.688528 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f36e0-5bbe-4d78-b6ca-a3939105b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.689211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f36e0-5bbe-4d78-b6ca-a3939105b966 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.689505 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f36e0-5bbe-4d78-b6ca-a3939105b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.689791 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f36e0-5bbe-4d78-b6ca-a3939105b966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.690524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f36e0-5bbe-4d78-b6ca-a3939105b966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.692178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f36e0-5bbe-4d78-b6ca-a3939105b966 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.703804 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1384/2809] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:26.711060 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.721954 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b722bc-6c28-4407-b548-550761b7d15f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.726830 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.727769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.728055 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.728342 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] PATH_INFO: `/v3/projects/ae9be93517fe4970b004191eb80b1ac4/users/5c49a223317640619a64cd5c63109eaa/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.746628 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9be93517fe4970b004191eb80b1ac4, user_id=5c49a223317640619a64cd5c63109eaa, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.753721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.846322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1426/2810] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:26 2022] PUT /identity/v3/projects/ae9be93517fe4970b004191eb80b1ac4/users/5c49a223317640619a64cd5c63109eaa/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:26.857150 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.857624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.858089 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.898789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] MFA Rules not processed for user `5c49a223317640619a64cd5c63109eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:26.900049 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.966194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1385/2811] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:26.970683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.033844 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4debc-9872-45a9-bbfb-13b2104c04b2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.039737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.040404 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.040690 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.041038 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.042311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.044297 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.091090 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.092546 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:27.135424 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1427/2812] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:42:26 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:27.136589 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.150140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37455e59-7328-4a40-b37c-abd42aff1bc3 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.197972 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6877-c714-4ce7-a62f-8eb82a8fedb8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.198844 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.199511 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.199802 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.200073 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.201810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:27.202763 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.203714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.203998 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.204272 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.204951 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.206864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.275830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.277175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.286859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1386/2813] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:27.333967 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1428/2814] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:42:27 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:27.336670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.347152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89281af-f4c9-4e49-ac3d-381848d442e8 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.354570 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.355379 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.355735 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.356127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.357037 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.358842 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.371524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1387/2815] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:27.374295 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.384423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ea8b-1825-4426-a5a4-85f79264557e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.390293 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.391187 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.392252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.392252 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] PATH_INFO: `/v3/projects/64352173cc6e432d8a6a44e200486107/users/b97b879a80994f74911cd428eea552dd/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.407903 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64352173cc6e432d8a6a44e200486107, user_id=b97b879a80994f74911cd428eea552dd, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.410746 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.511950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1429/2816] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:27 2022] PUT /identity/v3/projects/64352173cc6e432d8a6a44e200486107/users/b97b879a80994f74911cd428eea552dd/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:27.516158 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.527127 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad85b3-34bc-40bb-bbf5-75d05fc5adbe admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.587684 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac24d9-32a3-4348-8fcb-fdf5de1e3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.588362 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac24d9-32a3-4348-8fcb-fdf5de1e3cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.588641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac24d9-32a3-4348-8fcb-fdf5de1e3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.588922 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac24d9-32a3-4348-8fcb-fdf5de1e3cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.589640 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac24d9-32a3-4348-8fcb-fdf5de1e3cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.591225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac24d9-32a3-4348-8fcb-fdf5de1e3cc3 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.601670 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1388/2817] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:27.605847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.616103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e0ac2-3e5c-4fad-b4ae-b92293fdd255 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.620848 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.626832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.626832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.626832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] PATH_INFO: `/v3/projects/64352173cc6e432d8a6a44e200486107/users/b97b879a80994f74911cd428eea552dd/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.626832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64352173cc6e432d8a6a44e200486107, user_id=b97b879a80994f74911cd428eea552dd, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.626832 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.637766 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1430/2818] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:27 2022] PUT /identity/v3/projects/64352173cc6e432d8a6a44e200486107/users/b97b879a80994f74911cd428eea552dd/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:27.649731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3834-10e8-439b-b1b3-3d67233b6cfb None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.650021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3834-10e8-439b-b1b3-3d67233b6cfb None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.650301 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3834-10e8-439b-b1b3-3d67233b6cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.677514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-29fd3834-10e8-439b-b1b3-3d67233b6cfb None None] MFA Rules not processed for user `b97b879a80994f74911cd428eea552dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:27.678755 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-29fd3834-10e8-439b-b1b3-3d67233b6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:27.754170 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1389/2819] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:27.767997 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.769983 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:27.830879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057ee18-1ca4-4827-926a-321a268ee09b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.834811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684210c-286d-4609-a333-9028afc91da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.836123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684210c-286d-4609-a333-9028afc91da8 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.836354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684210c-286d-4609-a333-9028afc91da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.836631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684210c-286d-4609-a333-9028afc91da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.894528 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684210c-286d-4609-a333-9028afc91da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.896034 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684210c-286d-4609-a333-9028afc91da8 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.905979 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1431/2820] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:31.037217 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3834-10e8-439b-b1b3-3d67233b6cfb None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.100220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3834-10e8-439b-b1b3-3d67233b6cfb None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.104957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.105829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.106110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.106383 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] PATH_INFO: `/v3/users/5c49a223317640619a64cd5c63109eaa` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.107606 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c49a223317640619a64cd5c63109eaa)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.109531 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.298287 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c49a223317640619a64cd5c63109eaa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.305551 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c49a223317640619a64cd5c63109eaa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.359046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c49a223317640619a64cd5c63109eaa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.371904 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c49a223317640619a64cd5c63109eaa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.372555 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c49a223317640619a64cd5c63109eaa'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.378349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1390/2821] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:31 2022] DELETE /identity/v3/users/5c49a223317640619a64cd5c63109eaa => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:31.382982 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.383518 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.383633 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.401086 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:31.402304 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.463078 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1432/2822] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:31.474867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.477624 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.539966 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56750bf-4247-4af5-a372-96e9d5d3ae23 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.543768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.544435 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.544719 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.544999 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.555609 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.556944 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.568132 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1391/2823] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:32.021118 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:32.022612 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:32.035702 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f1c1d-13aa-4c6f-a732-36ea0f68aea2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.043613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.045685 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.046523 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.047245 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] PATH_INFO: `/v3/projects/ae9be93517fe4970b004191eb80b1ac4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.049737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9be93517fe4970b004191eb80b1ac4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.053769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:32.220241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9be93517fe4970b004191eb80b1ac4', 'request_id': 'req-bcb57e7f-926e-4060-95d3-03070f03eba5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.226856 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9be93517fe4970b004191eb80b1ac4', 'request_id': 'req-bcb57e7f-926e-4060-95d3-03070f03eba5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.290305 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9be93517fe4970b004191eb80b1ac4', 'request_id': 'req-bcb57e7f-926e-4060-95d3-03070f03eba5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.302520 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] The token cache is being invalidate because project ae9be93517fe4970b004191eb80b1ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:32.302805 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.303774 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.305207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1433/2824] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:32 2022] DELETE /identity/v3/projects/ae9be93517fe4970b004191eb80b1ac4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:32.310041 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:32.320615 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9547103-70ba-45a4-ac55-f56335cfe7c5 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.384925 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.385828 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.386140 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.386426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] PATH_INFO: `/v3/users/b97b879a80994f74911cd428eea552dd` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.387827 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97b879a80994f74911cd428eea552dd)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.389849 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:32.600380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97b879a80994f74911cd428eea552dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.608288 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97b879a80994f74911cd428eea552dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.697400 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97b879a80994f74911cd428eea552dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.713625 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97b879a80994f74911cd428eea552dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.714503 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97b879a80994f74911cd428eea552dd'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:32.722824 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1392/2825] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:32 2022] DELETE /identity/v3/users/b97b879a80994f74911cd428eea552dd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:33.001803 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.003257 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.139004 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57e7f-926e-4060-95d3-03070f03eba5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.241140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1de2d1-3e6b-484c-bef8-d95dada01768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.243311 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1de2d1-3e6b-484c-bef8-d95dada01768 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.243769 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1de2d1-3e6b-484c-bef8-d95dada01768 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.244144 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1de2d1-3e6b-484c-bef8-d95dada01768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.246353 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ff1de2d1-3e6b-484c-bef8-d95dada01768 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.266463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.269915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.284180 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1de2d1-3e6b-484c-bef8-d95dada01768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.286557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1de2d1-3e6b-484c-bef8-d95dada01768 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.301523 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1434/2826] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:33.368302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6de69-9265-41d6-b684-cf5c8f72aa84 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.374830 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.375853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.376214 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.376571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] PATH_INFO: `/v3/projects/64352173cc6e432d8a6a44e200486107` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.378182 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=64352173cc6e432d8a6a44e200486107)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.380306 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.501533 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64352173cc6e432d8a6a44e200486107', 'request_id': 'req-4deda027-0ed2-43cd-8bc9-5b15551712ff'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:33.509716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64352173cc6e432d8a6a44e200486107', 'request_id': 'req-4deda027-0ed2-43cd-8bc9-5b15551712ff'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:33.579236 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64352173cc6e432d8a6a44e200486107', 'request_id': 'req-4deda027-0ed2-43cd-8bc9-5b15551712ff'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:33.597452 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] The token cache is being invalidate because project 64352173cc6e432d8a6a44e200486107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:33.597743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:33.598436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-4deda027-0ed2-43cd-8bc9-5b15551712ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:33.600543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1393/2827] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:42:33 2022] DELETE /identity/v3/projects/64352173cc6e432d8a6a44e200486107 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:33.605637 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4798a3-dad5-413f-94b4-398d9a3a0694 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.605931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4798a3-dad5-413f-94b4-398d9a3a0694 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.606246 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4798a3-dad5-413f-94b4-398d9a3a0694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.633149 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-dc4798a3-dad5-413f-94b4-398d9a3a0694 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:33.634793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dc4798a3-dad5-413f-94b4-398d9a3a0694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.714714 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1435/2828] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:33.722729 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939b2ab-1b20-41c0-b6a5-66ce4ac657ac None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.723200 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939b2ab-1b20-41c0-b6a5-66ce4ac657ac None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.723441 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939b2ab-1b20-41c0-b6a5-66ce4ac657ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.745348 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-6939b2ab-1b20-41c0-b6a5-66ce4ac657ac None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:33.746957 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6939b2ab-1b20-41c0-b6a5-66ce4ac657ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.759388 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1394/2829] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:33.764741 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4798a3-dad5-413f-94b4-398d9a3a0694 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.779657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4798a3-dad5-413f-94b4-398d9a3a0694 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.784990 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.785768 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.786049 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.792371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.792371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:33.792371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.792371 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.803513 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1436/2830] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:33.806939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939b2ab-1b20-41c0-b6a5-66ce4ac657ac None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.816454 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939b2ab-1b20-41c0-b6a5-66ce4ac657ac None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.821714 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.822387 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.822667 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.822942 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.823687 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.825785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.897867 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1395/2831] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:33.902810 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.912809 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea0d1-40a7-4e59-b5a8-bb33945b232e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.971864 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.972536 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.972824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.973103 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.973787 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.975747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.063073 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1437/2832] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:34.067256 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.078426 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285b3a-10b4-4ee9-83d4-16903b3c77ff admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.083063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.083748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.084033 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.084311 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.085031 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.086652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.096972 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1396/2833] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:34.100942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.110733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048eda-d6bb-48c3-9227-82b2b3125641 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.115243 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36397ef0-eb3d-46d3-af50-9e370d8e2a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.115931 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36397ef0-eb3d-46d3-af50-9e370d8e2a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.116213 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36397ef0-eb3d-46d3-af50-9e370d8e2a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.116487 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36397ef0-eb3d-46d3-af50-9e370d8e2a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.117733 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36397ef0-eb3d-46d3-af50-9e370d8e2a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.119310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36397ef0-eb3d-46d3-af50-9e370d8e2a75 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.129391 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1438/2834] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:34.134020 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.143695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53242-71f5-46fa-8aa6-f76076587240 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.148243 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.149110 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.149396 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.149675 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] PATH_INFO: `/v3/projects/235f100a8e7342e8b887af3c32469763/users/4a667ed949174c559a8fdf6fe761f2bf/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.163706 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=235f100a8e7342e8b887af3c32469763, user_id=4a667ed949174c559a8fdf6fe761f2bf, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.166302 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.244806 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1397/2835] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:42:34 2022] PUT /identity/v3/projects/235f100a8e7342e8b887af3c32469763/users/4a667ed949174c559a8fdf6fe761f2bf/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:34.254885 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046026f-0e93-4fe0-adab-b51a7831a858 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.255178 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046026f-0e93-4fe0-adab-b51a7831a858 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.255595 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046026f-0e93-4fe0-adab-b51a7831a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.281798 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6046026f-0e93-4fe0-adab-b51a7831a858 None None] MFA Rules not processed for user `4a667ed949174c559a8fdf6fe761f2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:34.283000 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6046026f-0e93-4fe0-adab-b51a7831a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:34.344695 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1439/2836] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:34.355697 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.357494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:34.412720 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967242c-70b9-473f-a981-ce70bcb7d47e admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.417146 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b39ff-e2c8-4784-8f4f-d940faa15b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd89045deca342e5a4a6fa39c5bde4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.417726 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b39ff-e2c8-4784-8f4f-d940faa15b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.418005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b39ff-e2c8-4784-8f4f-d940faa15b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.418279 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b39ff-e2c8-4784-8f4f-d940faa15b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.426412 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b39ff-e2c8-4784-8f4f-d940faa15b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.427858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b39ff-e2c8-4784-8f4f-d940faa15b4a service cinder] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.436998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1398/2837] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:42:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:36.233120 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:36.233721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:36.233721 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:36.252381 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] MFA Rules not processed for user `4a667ed949174c559a8fdf6fe761f2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:36.253572 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:36.261028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1440/2838] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:53.367324 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ecf63-cb83-4023-9d7c-a37c36dfb73c None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:53.367880 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ecf63-cb83-4023-9d7c-a37c36dfb73c None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:53.367987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ecf63-cb83-4023-9d7c-a37c36dfb73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:53.389998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-342ecf63-cb83-4023-9d7c-a37c36dfb73c None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:53.391213 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-342ecf63-cb83-4023-9d7c-a37c36dfb73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:53.447337 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1399/2839] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:53.469858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:53.471354 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:53.567591 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b80b59-3514-4913-80b1-b6c6d3214a3f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:53.572887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:53.573548 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:53.573837 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:53.574123 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:53.584249 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:53.587953 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:53.603650 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1441/2840] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:42:54.522142 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3447-bf6f-48cf-972c-4f89f3ffa849 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:54.522666 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3447-bf6f-48cf-972c-4f89f3ffa849 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:54.522785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3447-bf6f-48cf-972c-4f89f3ffa849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:54.544021 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-ba6f3447-bf6f-48cf-972c-4f89f3ffa849 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:54.545295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ba6f3447-bf6f-48cf-972c-4f89f3ffa849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:54.552869 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1400/2841] 10.222.0.55 () {58 vars in 967 bytes} [Thu May 5 15:42:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:54.570575 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:54.582210 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d149-00aa-4e7b-b0a1-32ea1c6ac756 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:54.587561 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:54.588261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:54.588542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:54.588821 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:54.601437 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:54.603220 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:54.612016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1442/2842] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:42:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:42:55.530548 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413b8d-3634-4fee-98a5-504398f09f7b None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.531118 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413b8d-3634-4fee-98a5-504398f09f7b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.531220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413b8d-3634-4fee-98a5-504398f09f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.550663 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-8e413b8d-3634-4fee-98a5-504398f09f7b None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:55.551936 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-8e413b8d-3634-4fee-98a5-504398f09f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:55.559524 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1401/2843] 10.222.0.55 () {58 vars in 1009 bytes} [Thu May 5 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:55.572635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.592441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe045a-0950-4156-9da6-b7ab10389027 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.598047 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.598749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.599033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.599313 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.609676 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.612804 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.626716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1443/2844] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:42:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:42:56.452808 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537601db-1a7b-455c-bcfd-90b2cac273c9 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:56.453099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537601db-1a7b-455c-bcfd-90b2cac273c9 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:56.453380 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537601db-1a7b-455c-bcfd-90b2cac273c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:56.471940 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-537601db-1a7b-455c-bcfd-90b2cac273c9 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:56.473155 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-537601db-1a7b-455c-bcfd-90b2cac273c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:56.480982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1402/2845] 10.222.0.55 () {58 vars in 967 bytes} [Thu May 5 15:42:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:56.493327 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:56.504462 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ade58-9eec-4a96-a8db-ec9469aabbb7 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:56.509964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17ea24-2606-478b-a206-830775a5fb04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:56.510657 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ea24-2606-478b-a206-830775a5fb04 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:56.510974 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ea24-2606-478b-a206-830775a5fb04 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:56.511253 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ea24-2606-478b-a206-830775a5fb04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:56.522026 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ea24-2606-478b-a206-830775a5fb04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:56.524198 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ea24-2606-478b-a206-830775a5fb04 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:56.532635 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1444/2846] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:42:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:42:59.533506 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537601db-1a7b-455c-bcfd-90b2cac273c9 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:59.602915 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537601db-1a7b-455c-bcfd-90b2cac273c9 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:59.607500 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:59.608382 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:59.608669 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:59.608977 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] PATH_INFO: `/v3/users/4a667ed949174c559a8fdf6fe761f2bf` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:59.610172 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a667ed949174c559a8fdf6fe761f2bf)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:59.612148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:59.832453 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a667ed949174c559a8fdf6fe761f2bf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:59.839740 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a667ed949174c559a8fdf6fe761f2bf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:59.904180 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a667ed949174c559a8fdf6fe761f2bf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:59.918769 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a667ed949174c559a8fdf6fe761f2bf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:59.919595 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a667ed949174c559a8fdf6fe761f2bf'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:59.925768 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1403/2847] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:42:59 2022] DELETE /identity/v3/users/4a667ed949174c559a8fdf6fe761f2bf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:59.931362 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:59.932028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:59.932028 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:59.950080 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:59.951278 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:00.009507 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1445/2848] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:00.019227 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:00.020691 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:00.083099 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510fedb-530a-48fc-9c13-970c154f1376 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:00.086725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:00.087364 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:00.087672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:00.087949 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:00.097045 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:00.098460 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:00.108718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1404/2849] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:00.374104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:00.378833 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:00.389843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd192d-7452-4be1-98f1-213e3b4e92d0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:00.399225 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:00.400582 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:00.401110 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:00.401647 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] PATH_INFO: `/v3/projects/235f100a8e7342e8b887af3c32469763` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:00.403884 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] RBAC: Authorizing `identity:delete_project(project_id=235f100a8e7342e8b887af3c32469763)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:00.407794 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:00.549153 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235f100a8e7342e8b887af3c32469763', 'request_id': 'req-e167fe63-6926-48de-8694-2b12ab9f236f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:00.556879 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235f100a8e7342e8b887af3c32469763', 'request_id': 'req-e167fe63-6926-48de-8694-2b12ab9f236f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:00.663836 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235f100a8e7342e8b887af3c32469763', 'request_id': 'req-e167fe63-6926-48de-8694-2b12ab9f236f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:00.675892 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] The token cache is being invalidate because project 235f100a8e7342e8b887af3c32469763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:00.676183 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:00.676860 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e167fe63-6926-48de-8694-2b12ab9f236f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:00.680924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1446/2850] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:43:00 2022] DELETE /identity/v3/projects/235f100a8e7342e8b887af3c32469763 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:43.130136 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.132457 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.233171 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd843d9-de63-4bf4-b3fd-69572d120074 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.294933 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.295641 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.295918 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.296197 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.298071 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.309993 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.311731 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.323261 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1405/2851] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:43:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:45.152131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:45.152658 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:45.152853 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:45.213996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] MFA Rules not processed for user `8c8dbcc6772240dca87cba4dfa85d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:45.215195 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:45.284712 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1447/2852] 10.222.0.55 () {58 vars in 967 bytes} [Thu May 5 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:45.297353 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:45.298798 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:45.386565 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98bb39-621a-4124-9ecf-4ddfeea9b0ca service placement] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:45.391646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b75b16948240e0b3539152a63429d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:45.392297 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:45.392583 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:45.392865 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:45.401479 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:45.403063 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:45.410982 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1406/2853] 10.222.0.55 () {60 vars in 1384 bytes} [Thu May 5 15:43:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:43:54.004323 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:54.005781 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:54.071732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641228b-16eb-48e3-be1a-8c43c70977d1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:54.076779 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:54.077665 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:54.077975 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:54.078330 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] PATH_INFO: `/v3/users/1472fb57fb5848d6bd5c85852ac2eae9` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:54.079617 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1472fb57fb5848d6bd5c85852ac2eae9)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:54.081593 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:54.268752 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1472fb57fb5848d6bd5c85852ac2eae9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.269400 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1472fb57fb5848d6bd5c85852ac2eae9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.329580 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1472fb57fb5848d6bd5c85852ac2eae9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.337756 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1472fb57fb5848d6bd5c85852ac2eae9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.338583 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1472fb57fb5848d6bd5c85852ac2eae9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.356517 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1448/2854] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:43:54 2022] DELETE /identity/v3/users/1472fb57fb5848d6bd5c85852ac2eae9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:54.617249 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:54.627956 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285d927-7415-464d-97f4-d91ab7f8fc4a service swift] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:54.685273 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:54.686141 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:54.686429 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:54.686707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] PATH_INFO: `/v3/projects/1f8088c9f2ed4a259f79827002e54975` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:54.687934 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8088c9f2ed4a259f79827002e54975)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:54.689835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:54.815509 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8088c9f2ed4a259f79827002e54975', 'request_id': 'req-383e2792-f146-4a2a-a24d-8903fc898724'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.822105 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8088c9f2ed4a259f79827002e54975', 'request_id': 'req-383e2792-f146-4a2a-a24d-8903fc898724'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.889514 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8088c9f2ed4a259f79827002e54975', 'request_id': 'req-383e2792-f146-4a2a-a24d-8903fc898724'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.899853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] The token cache is being invalidate because project 1f8088c9f2ed4a259f79827002e54975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:54.902707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.902707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:54.902707 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1407/2855] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:43:54 2022] DELETE /identity/v3/projects/1f8088c9f2ed4a259f79827002e54975 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:54.906218 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:54.907654 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:54.920679 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3821a9a-e15b-4341-b784-d2c5a5969975 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:54.975016 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:54.975964 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:54.976241 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:54.976510 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] PATH_INFO: `/v3/users/ccd090f40ffb4d1cbcfd55b59c93319f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:54.977677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd090f40ffb4d1cbcfd55b59c93319f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:54.979611 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:55.160045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd090f40ffb4d1cbcfd55b59c93319f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.160753 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd090f40ffb4d1cbcfd55b59c93319f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.290322 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd090f40ffb4d1cbcfd55b59c93319f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.297683 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd090f40ffb4d1cbcfd55b59c93319f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.298326 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a26a4d59-6cd0-4014-8373-463e2fcec1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd090f40ffb4d1cbcfd55b59c93319f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.315847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1449/2856] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:43:54 2022] DELETE /identity/v3/users/ccd090f40ffb4d1cbcfd55b59c93319f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:55.588266 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:55.589782 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:55.602909 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e2792-f146-4a2a-a24d-8903fc898724 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:55.659518 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:55.660399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:55.660686 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:55.660964 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] PATH_INFO: `/v3/projects/ebdadd6f430e40659e5ea7397ed44547` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:55.662175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdadd6f430e40659e5ea7397ed44547)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:55.664676 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:55.774672 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdadd6f430e40659e5ea7397ed44547', 'request_id': 'req-860bdeec-08c7-4072-9537-447f57712351'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.780671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdadd6f430e40659e5ea7397ed44547', 'request_id': 'req-860bdeec-08c7-4072-9537-447f57712351'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.884326 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdadd6f430e40659e5ea7397ed44547', 'request_id': 'req-860bdeec-08c7-4072-9537-447f57712351'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.895046 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] The token cache is being invalidate because project ebdadd6f430e40659e5ea7397ed44547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:55.895336 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.895980 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-860bdeec-08c7-4072-9537-447f57712351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.898062 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1408/2857] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:43:55 2022] DELETE /identity/v3/projects/ebdadd6f430e40659e5ea7397ed44547 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:55.903115 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf594d1-bc69-462e-9649-c763f3775e7b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:55.903405 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf594d1-bc69-462e-9649-c763f3775e7b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:55.903716 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf594d1-bc69-462e-9649-c763f3775e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:55.922535 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6bf594d1-bc69-462e-9649-c763f3775e7b None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:55.923773 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6bf594d1-bc69-462e-9649-c763f3775e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:55.982169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1450/2858] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:55.990059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd701-21ec-4d83-b1b7-2253310bff37 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:55.990349 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd701-21ec-4d83-b1b7-2253310bff37 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:55.990628 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd701-21ec-4d83-b1b7-2253310bff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.009724 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-250dd701-21ec-4d83-b1b7-2253310bff37 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:56.010853 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-250dd701-21ec-4d83-b1b7-2253310bff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:56.018979 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1409/2859] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:56.023898 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf594d1-bc69-462e-9649-c763f3775e7b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.033543 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf594d1-bc69-462e-9649-c763f3775e7b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.038104 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.038754 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.039031 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.039306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.040065 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:56.040372 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.041955 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.053557 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1451/2860] 10.222.0.55 () {58 vars in 1152 bytes} [Thu May 5 15:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:56.067613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd701-21ec-4d83-b1b7-2253310bff37 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.077910 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd701-21ec-4d83-b1b7-2253310bff37 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.082998 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.083905 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.084194 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.084469 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.085997 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.087914 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.266091 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1410/2861] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:43:56 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:56.270348 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.281613 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd75f7-e691-45d4-85b8-6e6ac4c37338 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.338269 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.338940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.339221 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.339521 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.340259 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.342247 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.445052 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1452/2862] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:43:56 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:56.448987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.459262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfe6f3-9e8e-45bf-b5dd-1dfa9c87172f admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.466262 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.467399 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.467973 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.469413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.469413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.470785 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.484832 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1411/2863] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:56.489043 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.499496 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a4b3c-cbae-46e8-b506-f6248fe5d44b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.504677 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2912-435f-4eff-88da-7585efc53f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.506207 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2912-435f-4eff-88da-7585efc53f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.506530 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2912-435f-4eff-88da-7585efc53f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.506815 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2912-435f-4eff-88da-7585efc53f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.508306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c2912-435f-4eff-88da-7585efc53f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.509873 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c2912-435f-4eff-88da-7585efc53f3a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.520843 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1453/2864] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:56.524970 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.535152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f9ed-c853-4c5d-aaee-6d0b2e964f12 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.539941 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.540835 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] REQUEST_METHOD: `PUT` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.541124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.541406 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] PATH_INFO: `/v3/projects/4a3fa7e53a3746738e1b6f3b12abbe04/users/5a97d04903814e5db7f54287dc5f0368/roles/5520771cec5b4260bae84ce5d70ae39a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.556023 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3fa7e53a3746738e1b6f3b12abbe04, user_id=5a97d04903814e5db7f54287dc5f0368, role_id=5520771cec5b4260bae84ce5d70ae39a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.558743 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.639205 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1412/2865] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:43:56 2022] PUT /identity/v3/projects/4a3fa7e53a3746738e1b6f3b12abbe04/users/5a97d04903814e5db7f54287dc5f0368/roles/5520771cec5b4260bae84ce5d70ae39a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:56.644310 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f73d8-6ace-4a41-8af0-4aee8a4f0ba0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.644601 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f73d8-6ace-4a41-8af0-4aee8a4f0ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.644880 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f73d8-6ace-4a41-8af0-4aee8a4f0ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.661840 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-711f73d8-6ace-4a41-8af0-4aee8a4f0ba0 None None] MFA Rules not processed for user `f207ee062b9d45669b77905195363950`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:56.663075 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-711f73d8-6ace-4a41-8af0-4aee8a4f0ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:56.722415 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1454/2866] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:56.732646 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.734527 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:56.800124 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479b84f-544c-4b14-aa97-decb4ebf786d admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.804569 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.805228 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.805517 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.805800 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.815963 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.817455 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.828323 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1413/2867] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:02.214501 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6be5-08bd-45f7-9fca-213f9bb6b963 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:02.215092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6be5-08bd-45f7-9fca-213f9bb6b963 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:02.215092 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6be5-08bd-45f7-9fca-213f9bb6b963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:02.245373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-27bd6be5-08bd-45f7-9fca-213f9bb6b963 None None] MFA Rules not processed for user `5a97d04903814e5db7f54287dc5f0368`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:02.246897 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-27bd6be5-08bd-45f7-9fca-213f9bb6b963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:02.321056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1455/2868] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:44:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:02.325946 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:02.338220 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2c33-1750-41f9-9500-783613ff21ad service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:02.344251 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:02.344987 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:02.345274 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:02.345584 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:02.346252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:02.348410 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:02.498152 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1414/2869] 10.222.0.55 () {60 vars in 1152 bytes} [Thu May 5 15:44:02 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:02.502631 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6be5-08bd-45f7-9fca-213f9bb6b963 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:02.514236 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6be5-08bd-45f7-9fca-213f9bb6b963 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:02.588296 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:02.588971 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:02.589399 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:02.589755 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:02.590306 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:02.592190 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:02.692800 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1456/2870] 10.222.0.55 () {60 vars in 1143 bytes} [Thu May 5 15:44:02 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:02.694193 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:02.704705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30e027-61f5-439a-93b9-77d09d41b8fa admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:02.709398 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:02.710601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:02.710884 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:02.711163 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:02.711929 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:02.713571 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:02.726269 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1415/2871] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:02.729937 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:02.740140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85386879-0a34-4259-aa6c-ff69ee6f0639 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:02.745024 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:02.745916 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:02.746203 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:02.746486 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] PATH_INFO: `/v3/projects/a2af48e93c384008bb6a7a1e352de3f4/users/3fd145e80bff4ad5a75ebcbea2367f4a/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:02.763618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2af48e93c384008bb6a7a1e352de3f4, user_id=3fd145e80bff4ad5a75ebcbea2367f4a, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:02.768858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:02.861824 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1457/2872] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:44:02 2022] PUT /identity/v3/projects/a2af48e93c384008bb6a7a1e352de3f4/users/3fd145e80bff4ad5a75ebcbea2367f4a/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:44:02.865863 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:02.876044 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91d4c9-326e-4969-9475-10338b9f9823 admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:02.932619 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d32fdd-9d24-47be-9be7-de107e965bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:02.933295 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d32fdd-9d24-47be-9be7-de107e965bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:02.933585 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d32fdd-9d24-47be-9be7-de107e965bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:02.933859 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d32fdd-9d24-47be-9be7-de107e965bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:02.934588 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d32fdd-9d24-47be-9be7-de107e965bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:02.936298 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d32fdd-9d24-47be-9be7-de107e965bc7 admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:02.950076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1416/2873] 10.222.0.55 () {58 vars in 1121 bytes} [Thu May 5 15:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:02.954691 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:02.967332 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772e723-0ba2-4986-aa8a-3ecca0190309 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:02.972461 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:02.973376 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:02.973649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:02.973924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] PATH_INFO: `/v3/projects/a2af48e93c384008bb6a7a1e352de3f4/users/3fd145e80bff4ad5a75ebcbea2367f4a/roles/87bed206da0e4d099e5d28c7da278f6b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:02.976425 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2af48e93c384008bb6a7a1e352de3f4, user_id=3fd145e80bff4ad5a75ebcbea2367f4a, role_id=87bed206da0e4d099e5d28c7da278f6b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:02.979116 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:02.993762 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1458/2874] 10.222.0.55 () {60 vars in 1482 bytes} [Thu May 5 15:44:02 2022] PUT /identity/v3/projects/a2af48e93c384008bb6a7a1e352de3f4/users/3fd145e80bff4ad5a75ebcbea2367f4a/roles/87bed206da0e4d099e5d28c7da278f6b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:08.933010 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6102-c42c-4251-90c9-66e22ad31d01 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:08.933582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6102-c42c-4251-90c9-66e22ad31d01 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:08.933582 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6102-c42c-4251-90c9-66e22ad31d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:08.960225 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-3a9b6102-c42c-4251-90c9-66e22ad31d01 None None] MFA Rules not processed for user `3fd145e80bff4ad5a75ebcbea2367f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:08.961444 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-3a9b6102-c42c-4251-90c9-66e22ad31d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:09.029513 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1417/2875] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:09.040948 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:09.042704 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:09.135942 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450df5-4b07-43dc-8cff-9e49b4666c53 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:09.141423 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:09.142069 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:09.142351 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:09.142629 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:09.196778 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:09.198363 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:09.207749 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1459/2876] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:44:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:11.868463 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173ad1-582e-439f-b1e8-17b5a2b0af49 None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:11.869022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173ad1-582e-439f-b1e8-17b5a2b0af49 None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:11.869022 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173ad1-582e-439f-b1e8-17b5a2b0af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:11.886770 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c4173ad1-582e-439f-b1e8-17b5a2b0af49 None None] MFA Rules not processed for user `5a97d04903814e5db7f54287dc5f0368`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:11.888059 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c4173ad1-582e-439f-b1e8-17b5a2b0af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:11.894990 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1418/2877] 10.222.0.55 () {58 vars in 957 bytes} [Thu May 5 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:46.630263 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:46.631706 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:46.687175 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5fe5-6041-409b-9781-84b4efae1ab1 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:46.690655 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:46.691290 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:46.691608 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:46.691887 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:46.701793 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:46.703224 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:46.712894 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1460/2878] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:44:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:44.239442 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173ad1-582e-439f-b1e8-17b5a2b0af49 None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:44.249211 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173ad1-582e-439f-b1e8-17b5a2b0af49 None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:44.253413 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:44.254148 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:44.254436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:44.254705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:44.256502 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:44.270355 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:44.271858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:44.283175 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1419/2879] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:45.468692 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:45.477505 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e3132-20f0-494a-a5d8-c1dac06446f6 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:45.481732 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:45.481881 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:45.482107 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:45.482383 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:45.484169 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:45.498271 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:45.499737 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:45.514338 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1461/2880] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:46:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:49.726823 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:49.735847 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488783-5716-4846-87fb-c28eec514988 service neutron] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:49.739634 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664db85a-8f74-436f-8df0-120d4693ff5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:49.740292 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db85a-8f74-436f-8df0-120d4693ff5f service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:49.740577 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db85a-8f74-436f-8df0-120d4693ff5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:49.740858 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db85a-8f74-436f-8df0-120d4693ff5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:49.742705 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-664db85a-8f74-436f-8df0-120d4693ff5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:49.753658 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664db85a-8f74-436f-8df0-120d4693ff5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:49.755104 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664db85a-8f74-436f-8df0-120d4693ff5f service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:49.763567 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1420/2881] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:46:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:58.586051 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:58.595590 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cc574-6f80-4d24-a3d6-8bf8fa5a0b61 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:58.599441 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f76e9-80a9-47aa-a323-f76711c53c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:58.600119 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f76e9-80a9-47aa-a323-f76711c53c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:58.600406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f76e9-80a9-47aa-a323-f76711c53c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:58.600689 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f76e9-80a9-47aa-a323-f76711c53c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:58.602475 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e26f76e9-80a9-47aa-a323-f76711c53c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:58.613121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f76e9-80a9-47aa-a323-f76711c53c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:58.614585 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f76e9-80a9-47aa-a323-f76711c53c96 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:58.624003 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1462/2882] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:58.965817 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6fe9-52a5-4f4b-a991-764bc6d2981b None None] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:58.966416 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6fe9-52a5-4f4b-a991-764bc6d2981b None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:58.966543 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6fe9-52a5-4f4b-a991-764bc6d2981b None None] PATH_INFO: `/` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:58.968076 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1421/2883] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:46:58.974542 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42684a48-c7e3-45bb-a06a-b9a999875b02 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:58.974701 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42684a48-c7e3-45bb-a06a-b9a999875b02 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:58.977346 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42684a48-c7e3-45bb-a06a-b9a999875b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:59.013761 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-42684a48-c7e3-45bb-a06a-b9a999875b02 None None] MFA Rules not processed for user `9c25e83af7604455bad1d7c0ee1c0122`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:59.014996 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-42684a48-c7e3-45bb-a06a-b9a999875b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:59.021857 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1463/2884] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:59.036221 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a6fe9-52a5-4f4b-a991-764bc6d2981b None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:59.047695 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a6fe9-52a5-4f4b-a991-764bc6d2981b None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:59.051793 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8c3a4-8d99-42d5-8207-70fd2f3ed956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:59.052428 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c3a4-8d99-42d5-8207-70fd2f3ed956 service neutron] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:59.052901 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c3a4-8d99-42d5-8207-70fd2f3ed956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:59.053178 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c3a4-8d99-42d5-8207-70fd2f3ed956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:59.060618 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8c3a4-8d99-42d5-8207-70fd2f3ed956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:59.062040 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8c3a4-8d99-42d5-8207-70fd2f3ed956 service neutron] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:59.070765 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1422/2885] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:59.166373 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157002-4824-42eb-97a2-c1c0aa6262b9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:59.166720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157002-4824-42eb-97a2-c1c0aa6262b9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:59.166940 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157002-4824-42eb-97a2-c1c0aa6262b9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:59.168475 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1464/2886] 10.222.0.55 () {54 vars in 921 bytes} [Thu May 5 15:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:46:59.181310 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] REQUEST_METHOD: `POST` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:59.181601 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:59.181887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:59.225644 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.auth.core [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] MFA Rules not processed for user `abbda90b98bd49569e59c973edba73b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:59.226893 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:59.236357 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1423/2887] 10.222.0.55 () {58 vars in 1018 bytes} [Thu May 5 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:59.247720 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157002-4824-42eb-97a2-c1c0aa6262b9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:59.260747 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157002-4824-42eb-97a2-c1c0aa6262b9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:59.264469 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c25e83af7604455bad1d7c0ee1c0122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:59.265061 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:59.265344 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:59.265618 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:59.276594 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:59.278056 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:59.290360 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1465/2888] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:59.357242 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:59.358651 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:59.429752 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090747e-644e-4c9b-80ac-f1d277e5f0ee None None] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:59.434789 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:59.435436 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:59.435756 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:59.436034 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:59.437850 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:59.449887 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:59.451631 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:59.462613 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1424/2889] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:48:30.993199 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:30.994734 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:31.010923 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c02c-99a1-45d9-a2a4-1c171b47b8fc service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:31.018132 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abbda90b98bd49569e59c973edba73b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:31.019577 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:31.019858 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:31.020135 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:31.022033 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:31.041865 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:31.043600 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:31.066924 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1466/2890] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:48:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:48:44.270209 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:44.339372 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c9516-1ef8-4968-b460-f97230637584 service placement] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:44.345072 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:44.345947 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:44.346373 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:44.346652 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] PATH_INFO: `/v3/users/5a97d04903814e5db7f54287dc5f0368` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:44.347897 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a97d04903814e5db7f54287dc5f0368)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:44.349829 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:44.548671 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a97d04903814e5db7f54287dc5f0368'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:44.555268 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a97d04903814e5db7f54287dc5f0368'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:44.637810 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a97d04903814e5db7f54287dc5f0368'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:44.650716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a97d04903814e5db7f54287dc5f0368'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:44.655883 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a97d04903814e5db7f54287dc5f0368'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:44.657186 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1425/2891] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:48:44 2022] DELETE /identity/v3/users/5a97d04903814e5db7f54287dc5f0368 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:48:44.918045 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:44.929771 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202fba1-0186-4f27-8d03-63c356d19fb7 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:44.985950 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:44.986819 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:44.987100 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:44.987378 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] PATH_INFO: `/v3/projects/4a3fa7e53a3746738e1b6f3b12abbe04` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:44.988649 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3fa7e53a3746738e1b6f3b12abbe04)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:44.990558 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:45.101347 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3fa7e53a3746738e1b6f3b12abbe04', 'request_id': 'req-ee370ebd-bcf0-4720-b580-0ec0b10b7273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.107877 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3fa7e53a3746738e1b6f3b12abbe04', 'request_id': 'req-ee370ebd-bcf0-4720-b580-0ec0b10b7273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.196614 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3fa7e53a3746738e1b6f3b12abbe04', 'request_id': 'req-ee370ebd-bcf0-4720-b580-0ec0b10b7273'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.207610 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] The token cache is being invalidate because project 4a3fa7e53a3746738e1b6f3b12abbe04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:48:45.207932 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.208587 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.210151 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1467/2892] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:48:44 2022] DELETE /identity/v3/projects/4a3fa7e53a3746738e1b6f3b12abbe04 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:48:45.214252 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:45.215718 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:45.228939 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd88e7-4208-4d14-9349-165b8c91a00b admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:45.295257 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:45.296168 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:45.296451 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:45.296725 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] PATH_INFO: `/v3/users/3fd145e80bff4ad5a75ebcbea2367f4a` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:45.298000 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd145e80bff4ad5a75ebcbea2367f4a)` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:45.299997 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:45.513703 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd145e80bff4ad5a75ebcbea2367f4a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.520732 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd145e80bff4ad5a75ebcbea2367f4a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.586480 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd145e80bff4ad5a75ebcbea2367f4a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.599004 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd145e80bff4ad5a75ebcbea2367f4a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.599736 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.notifications [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd145e80bff4ad5a75ebcbea2367f4a'} {{(pid=80084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:45.606183 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1426/2893] 10.222.0.55 () {58 vars in 1223 bytes} [Thu May 5 15:48:45 2022] DELETE /identity/v3/users/3fd145e80bff4ad5a75ebcbea2367f4a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:48:45.864140 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:45.865772 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:45.880795 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee370ebd-bcf0-4720-b580-0ec0b10b7273 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:45.955976 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f207ee062b9d45669b77905195363950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a7cd6436bd466e8794acccf97ede79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:45.956846 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:45.957131 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:45.957406 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] PATH_INFO: `/v3/projects/a2af48e93c384008bb6a7a1e352de3f4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:45.958597 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2af48e93c384008bb6a7a1e352de3f4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:45.961298 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:46.083340 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2af48e93c384008bb6a7a1e352de3f4', 'request_id': 'req-c910784d-3d8a-4028-a45c-a1469a80d325'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:46.090089 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2af48e93c384008bb6a7a1e352de3f4', 'request_id': 'req-c910784d-3d8a-4028-a45c-a1469a80d325'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:46.163811 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2af48e93c384008bb6a7a1e352de3f4', 'request_id': 'req-c910784d-3d8a-4028-a45c-a1469a80d325'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:46.176261 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] The token cache is being invalidate because project a2af48e93c384008bb6a7a1e352de3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:48:46.176550 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:46.177201 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:48:46.178850 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1468/2894] 10.222.0.55 () {58 vars in 1232 bytes} [Thu May 5 15:48:45 2022] DELETE /identity/v3/projects/a2af48e93c384008bb6a7a1e352de3f4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:48:51.947494 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Authenticating user token {{(pid=80084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:51.948920 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:52.019916 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d287c9-7142-4362-9033-66aeb125affa admin admin] Validating token access rules against request {{(pid=80084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:52.093748 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40de932-a74f-4a40-9784-21fd2e06831b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:52.094430 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40de932-a74f-4a40-9784-21fd2e06831b service placement] REQUEST_METHOD: `GET` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:52.094716 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40de932-a74f-4a40-9784-21fd2e06831b service placement] SCRIPT_NAME: `/identity` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:52.095005 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40de932-a74f-4a40-9784-21fd2e06831b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:52.097130 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.fernet_utils [None req-c40de932-a74f-4a40-9784-21fd2e06831b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:52.111018 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40de932-a74f-4a40-9784-21fd2e06831b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:52.112955 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40de932-a74f-4a40-9784-21fd2e06831b service placement] RBAC: Authorization granted {{(pid=80084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:52.124696 dv-cinder-835881-6-iscsi devstack@keystone.service[80084]: [pid: 80084|app: 0|req: 1427/2895] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:48:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:53:58.924274 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:53:58.925847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:53:59.010866 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910784d-3d8a-4028-a45c-a1469a80d325 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:53:59.015920 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950147-7c6b-47e6-a174-92a57ddcb8a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b8520e6db2346c59a1230380c515703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82b2904f97ab480999aaefa22a0ae045', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:53:59.016567 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950147-7c6b-47e6-a174-92a57ddcb8a5 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:53:59.016847 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950147-7c6b-47e6-a174-92a57ddcb8a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:53:59.017121 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950147-7c6b-47e6-a174-92a57ddcb8a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:53:59.030449 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950147-7c6b-47e6-a174-92a57ddcb8a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:53:59.032177 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950147-7c6b-47e6-a174-92a57ddcb8a5 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:53:59.044025 dv-cinder-835881-6-iscsi devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1469/2896] 10.222.0.55 () {60 vars in 1365 bytes} [Thu May 5 15:53:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)